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Abstract 


The aim to decarbonize the energy supply represents a major technical and social challenge. 
The design of approaches for future energy network operation faces the technical challenge 
of needing to coordinate a vast number of new network participants spatially and temporally, 
in order to balance energy supply and demand, while achieving secure network operation. At 
the same time these approaches should ideally provide economic optimal solutions. In order 
to meet this challenge, the research field of transactive control emerged, which is based on 
an appropriate interaction of market and control mechanisms. These approaches have been 
extensively studied for electric power networks. In order to account for the strong differences 
between the operation of electric power networks and other energy networks, new approaches 
need to be developed. Therefore, within this work a new transactive control approach for Cou- 
pled Electric Power and District Heating Networks (CEPDHNs) is presented. As this is built 
upon a model-based control approach, a suitable model is designed first, which enables to op- 
erate coupled electric power and district heating networks as efficient as possible. Also, for the 
transactive control approach a new fitted procedure is developed to determine market clear- 
ing prices in the multi-energy system. Further, a distributed form of district heating network 
operation is designed in this context. The effectiveness of the presented approach is analyzed 
in multiple simulations, based on real world networks. 


Kurzfassung 


Die Dekarbonisierung der Energieversorgung stellt eine enorme technische und gesellschaft- 
liche Herausforderung dar. Der Entwurf von Ansätzen zur Betriebsführung zukünftiger Ener- 
gienetze sieht sich dabei zum einen der technischen Herausforderung gegenüber, eine enorme 
Anzahl von neuen Netzteilnehmern zeitlich und örtlich zu koordieren, um Erzeugung und Ver- 
brauch in Einklang zu bringen und dabei gleichzeitig einen sicheren Netzbetrieb zu gewährleis- 
ten. Zum anderen sollten diese Ansätze idealerweise ökonomisch optimale Lösungen hervor- 
bringen. Um dieser Herausforderung zu begegnen entstand das Forschungsfeld der Transactive 
Control Ansätze, welches auf einer geeigneten Verzahnung von Markt- und Regelmechanis- 
men beruht. Diese Ansätze wurden bisher umfassend für rein elektrische Netze untersucht. 
Um den großen Unterschieden in der Betriebsführung zwischen Stromnetzen und anderen 
Energienetzen Rechnung zu tragen, bedarf es der Entwicklung neuer Verfahren. Daher wird 
im Rahmen dieser Arbeit ein neuer Transactive Control Ansatz für gekoppelte Strom- und 
Wärmenetze vorgestellt. Da dieser auf einem modellbasierten Regelungsverfahren beruht, 
wird zunächst ein geeignetes Modell entworfen, welches es ermöglicht, gekoppelte Strom- und 
Wärmenetze möglichst effizient zu betreiben. Zudem wird für den Transactive Control Ansatz 
ein neues Verfahren zur Bestimmung geeigneter Markträumungspreise, im sektorengekoppel- 
ten System, entwickelt. Außerdem wird in diesem Kontext ein neues Verfahren zur verteilten 
Betriebsführung von Wärmenetzen entworfen. Die Wirksamkeit der Verfahren wird an Simu- 
lationsergebnissen, basierend auf realen Netzdaten, analysiert. 
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ofp Flow direction on Flow Direction Path (FDP) 
got Flow direction Opposed to Flow Direction Path (OFDP) 
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Symbol Description 

S Set 

rer Auxiliary water mass parameter 

T Temperature 

Bea Maximum length of stay of water mass in pipeline 

t Length of stay of water mass in pipeline 

Te? Ambient temperature 

hee Temperature at bottom of storage 

ioe Dead time 

ER Freezing temperature 

T Predicted temperature 

qi Input temperature 

I Mean temperature 

TERS Measured temperature 

pout Outlet temperature 

outi Lossless pipeline outlet temperature 

Tome Lossy pipeline outlet temperature 

TP Temperature of time step before simulation/prediction horizon 

Le Temperature ramping limit 

Tt Temperature at top of storage 

T Pipeline loss coefficient 

u” Vector of optimal control values 

u Vector of control values 

uemp Amount of power traded at Uniform Marginal Price (UMP) 

Leer? Amount of power traded at Uniform Marginal Price obtained from Dis- 
patch (UMPD) 

V Voltage amplitude 

v Flow velocity 

W Social welfare 

w Weight parameters in pipeline model 

qurectih Weight influencing height of rectangular function approximation 

wrectw Weight influencing width of rectangular function approximation 

Xo Initial variable vector 

x Optimization variable 

x Variable vector 

xt Vector of power demand by all consumers 

x Vector of supplied power by all producers 

x Real values multidimentional set 

gt Vector of system state variables 

ete Vector of initial system state 

E Friction factor 

y? Starting point for optimization 


x 
og 
5 


Nodal admittance matrix 


XXI Abbreviations and Symbols 
Symbol Description 
Yf, Yf, y? Auxiliary admittance matrix 
y” m-equivalent admittance 
ye Shunt admittance 
ye Shunt admittance vector 
y* Second-order Karush-Kuhn-Tucker (KKT) point 
Y’ Shunt admittance per length and phase 
Y. yY, yt Auxiliary admittance matrix 
y Transmission line admittance matrix 
Z Entering time step matrix element 
Z Entering time step matrix 
gaar Characteristic impedance 
ZP Entering past time step matrix element 
ZP Entering past time step matrix 
zZ” m-equivalent impedance 
Z Real values multidimentional set 
ze Vector of algebraic state variables 
zZ Serial impedance per length and phase 
z Optmization variable 
z Vector of optimization variables 
Operators 
Operator Description 


^A 


Estimated or predicted value 
Complex value 

i-th Element of a vector 

(i,j)-th Element of a matrix 

Inverse of a matrix 

Differential operator 

Variable transformed into parameter 
Alias of index 

Spectral radius 

Alias if applied to index 


Transposed vector or matrix 


Indices and Superscripts 


Abbreviation Description 
0 Initial state, reference value 
b Boundary 
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Abbreviation Description 

cp Control path 

e Edge 

ev Event 

ii Node/Bus 

k, k Time step 

kP, kP Past time step 

l Loop 

m Polynomial order 

n Network participant 

naea Network Participant (NP) of District Heating Network (DHN) 
nepn Network Participant (NP) of Electric Power Network (EPN) 
v Iteration of distributed optimization approach 

0,6 Flow direction 

o~ Flow against edge direction 

or Flow in edge direction 


Position in pipeline, counted from the node where water masses enter 
the pipeline for a specific flow direction o 


Incoming edge, positive flow direction 
Leaving edge, negative flow direction 
Ambient temperature 

Augmented Lagrangian 

All 

After rolling horizon time step shift 
Border edge 

Border node 

Border loop 

Bottom of storage 

Before rolling horizon time step shift 
Bus 

Cardinality of edges 

Central 

Characteristic 

Charging 

Cardinality of buses 

Cardinality of time steps 

Critical 

Cross section 

Demand 

Discharging 

Extension of objective function 
Deviation 


XXIV Abbreviations and Symbols 
Abbreviation Description 
dhn District Heating Network (DHN) 
dist Distributed 
dpr Differential Pressure Regulator (DPR) 
epn Electric Power Network (EPN) 
exch Heat exchanger 
f From 
fdp Flow Direction Path (FDP) 
ff From from 
flow (Line) Flow 
fnp Flexible Network Participant (FNP) 
freeze Freezing (temperature) 
ft From to 
haa Haaland 
hydr Hydraulic 
in Input of edge 
inp Inflexible Network Participant (INP) 
max Maximum 
mean Mean value 
meas Measurement 
min Minimum 
new New 
np Network Participant (NP) 
obj Objective 
ocd Optimality Condition Decomposition (OCD) 
ofdp Opposed to Flow Direction Path (OFDP) 
out Outlet of edge 
outl Lossless pipeline outlet temperature 
out2 Lossy pipeline outlet temperature 
p Past 
pe Propagation constant 
T m-equivalent 
pipe Pipeline 
pre Predefined before simulation/optimization 
pump Pump 
ramp Ramping limit 
ref Reference 
rest Rest 
m Return network 
s Supply 
sh Shunt 
sn Supply network 
steam Steam (pressure) 
* (At) Optimal point 
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Abbreviation Description 

stor Storage 

swamee Swamee 

t To 

tf To from 

therm Thermal 

top Top of storage 

trl Transmission line 

tt To to 

umpd (Value at) Uniform Marginal Price obtained from Dispatch 
vlv Valve 

vmfd Variable Mass Flow Direction (VMFD) 
w Water 

wm Water mass 

za Zone a 

zb Zone b 


1 Introduction 


1.1 Motivation 


To limit the impacts of climate change societies around the world are putting forward large 
efforts to decarbonize their energy supply. In order to maintain social acceptance political au- 
thorities thereby always seek to keep the financial burden as low as possible [GCM17]. Thus, 
the following four measures have been partly, and further need to be, implemented to achieve 
the aforementioned goals: 

First, a CO% free supply with electricity and heat needs to be achieved. Therefore, Re- 
newable Energy Sources (RESs) such as wind, solar, biogas, hydro, marine and geothermal 
power plants are integrated into energy networks in large scale to decarbonize the energy 
supply. Renewable energy accounted for 12.6 % of the total energy supply in 2020 and more 
than 10% of the electric power demand in 2021 worldwide [REN22]. However, the energy 
production of RESs is strongly volatile [LLJZ20] and largely decentralizes the power infeed 
into the energy systems [ZBC04], which necessitates further measures stated below. The de- 
carbonization of District Heating Networks (DHNs) is achieved by installing Combined Heat 
and Power (CHP) plants, Heat Pumps (HPs) and Electric Boilers (EBs) which are then run with 
green gas and electricity produced by RESs [NMZ* 16]. This intensifies the interaction of Elec- 
tric Power Networks (EPNs) and DHNs [CWW+ 18b]. This coupling is further increased by 
utilizing the waste heat originating from the cooling of supermarkets [GS21a], data centers 
[LSG* 17], and industrial processes powered by electricity [PSH20]. The possibility of using 
this (decentral) waste heat is a major driver to further expand existing DHNs and design new 
forms of DHN operation [LSG*17]. Already nowadays, the utilization of DHNs reduces the 
CO» emissions in Europe by 113 million tons per year, which sums up to 2.6 % of the Euro- 
pean CO, emissions [LSZW15]. Thus, DHNs will play a central role in future energy systems 
[MD17]. 


Second, the provision of flexibility through storages, power plants and Demand-Side Man- 
agement (DSM) is mandatory to match energy supply and demand in the presence of strongly 
volatile energy supply of RESs. Therefore, storage systems! are more and more integrated in 
the EPNs. Nevertheless, storing electric energy with high efficiency, low costs, and ecologic 
compatibility is still a major issue [ARRB16], [GT17b]. However, storing thermal energy over 
long, even seasonal, periods at low costs is comparatively simple [XWL14] and thus thermal 
storages are an inherent part of facilities and DHNs[CMT*17, p. 76]. Thus, operators of 
DHNs have been incentivized to construct large water storages in the last years in Germany 


! For example battery power plants, pumped storage hydro power stations or compressed air energy storages. Other 


concepts such as the usage of electric vehicles [DTKM18], gravity storages [Fyk19], underwater hydro storages 
[KAA+ 19], chemical storages [DDKB*+ 20], and thermal storages [SS18] are also being tested. 
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[CMT* 17, p. 79]. Further, a large potential is seen in utilizing the thermal water storages in 
facilities. For example in Germany 90 % of the present buildings using a heat pump are also 
equipped with a thermal water storage [ZWW*21]. These potentials need to be made uti- 
lizable by creating incentives for facilities by adequate jurisdictions and market frameworks 
[CN17]. General benefits arising from flexibility provision by DSM include less needed gener- 
ator capacities, reduced generation costs due to less fossil fuels needed to run stand by capac- 
ities, and thus also less emissions [Str08]. 


Third, the prevention of network congestions is a major task in the EPNs as the existing 
networks were planed based on scenarios with different energy flows’. Therefore, grid rein- 
forcements are necessary to adjust the EPNs to the current and future power flows. However, 
these take long planning periods and are very costly. Alone in Germany around 70 billion eu- 
ros are necessary for the extension of the transmission network until 2035 [Bun19b, p. 4] and 
another 54 to 75 billion euros for the distribution networks until 2050 [Ago19, p.10]. Thus, flex- 
ibilities already named above should not only be used to match demand and supply, but also 
to prevent congestions and thereby decrease the amount of necessary grid reinforcements. In 
this context, several studies have shown the effectiveness of optimally coordinating demand 
and supply of grid participants to reduce network reinforcements [CN17, p. 30]. 


Fourth, avoiding economic and technical inefficiencies is of central importance. Three 
aspects will be highlighted in the following. The prior and purely technical aspects regarded, 
are the heat losses in DHNs. Heat losses mainly occur in DHNs, based on the heat flow through 
pipeline insulation. As heat losses increase with rising difference between the fluid and the 
ambient temperature, these can be minimized by keeping the temperatures as low as possible 
[ZLG13].? Therefore, DHN operators aim to set the mass flows through the heat exchangers 
of Flexible Network Participants (FNPs) such that the temperature difference between supply 
and return network is maximized, and thereby the mass flows and the resulting pump costs 
are minimized [ZLG13]. These mass flows are adjusted by pumps, Differential Pressure Reg- 
ulators (DPRs), their respective control paths, and valves. As heat losses are in the range of 
12% to 20 % [VSLD13, CYC04, LMMD10], an efficient operation based on variable mass flows 
and variable temperatures is of significant interest. 


A further aspect causing technical and economic inefficiencies arises when market and con- 
trol mechanisms work separately or uncoordinated. Cases, where market mechanisms imple- 
mented without fully integrating the control mechanisms can be found in electricity markets 


2 Thereby, it was assumed, that energy is produced in a few large central plants and then distributed to the 


consumers over hierarchical structured networks. However, in the meantime the majority of newly connected 
RESs feed power into distribution networks instead of transmission networks [CN17, p. 29]. Additionally, novel 
consumers such as HPs and Electric Vehicles (EVs) consume more electric power and do so simultaneously in the 
same regions. Also, different RESs types, as solar panels and Wind Power Plants (WPPs), each generate regional 
correlations in their respective power supply due to similar meteorological conditions. The interplay of these 
effects as well as new regulations enabling competitive energy markets with numerous new decentralized market 
participants creates a rising amount of network congestions in EPNs [PKK15]. 

Supply network temperatures can only be reduced to a certain level in order to sufficiently supply the heat demand 
of customers. 
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cleared by uniform pricing. For example, in the European energy sector, electric energy mar- 
kets are operated based on uniform marginal pricing‘. Whenever the power flows resulting 
from their allocation lead to network congestions in Germany, a highly regulated redispatch 
procedure takes place which leads to uplift costs. Grid operators order redispatch and select 
suitable power plants. The units that are shut down receive compensation, while those that are 
started receive a corresponding payment. These additional costs are passed on to all electricity 
consumers as network fees [Bun18b]. The costs for these redispatch measures’ have risen in 
the past decades and exceeded 1.4 billion euros in 2020 in Germany [Bun22]. Also, the high 
amount of necessary command and control instructions has led to very complicated scenarios 
for system operators, in networks operated by these markets mechanisms [MSC03]. 


Last but not least, the aspect of techno-economic issues created by a separate operation of each 
domain of a Multi-Energy System (MES)® has to be kept in mind. Energy converters that are 
connected to DHNs and EPNs as e.g. PtH plants, or Combined Heat and Power (CHP) plants, 
are usually operated heat-driven or power-driven’. This form of operation and the concomi- 
tant form of pricing of energy, leads to cross-subsidies from one energy network to the other. 
A well known example of this phenomenon is the alternative power method, where the prices 
in DHNs are dependent on the outcome of electricity markets [DLS*19]. More general, when 
heat markets and electricity market clearing processes affect each other, for example due to 
energy converters which take part in both markets, simultaneous clearing with instantaneous 
communication between both markets is of interest to obtain an overall optimal result. Oth- 
erwise, in the case of sequential clearing, the first clearing process is dependent on predicted 
information of the second clearing process, and the feasible region of the second market clear- 
ing could be unfavorably constrained [ZWW* 21]. Further, a pure heat-driven or power-driven 
operation of energy converters neglects the ability to counteract contingencies in one of the 
connected network types. Besides, flexibilities existing in the DHNs, as large water storages 
[ZWW* 21], pipeline storage capabilities [Ick95] and DSM can not be optimally utilized to 
support the EPN in matching supply and demand. Also, due to a lack of coordinated opera- 
tion of DHNs and EPNs, wind power is curtailed in many cases which could have been used 
in PtH devices, to supply heat to DHNs [DF14, MKP20]. In addition to the aforementioned, 
Multi-Energy System (MES) also exploit better conversion efficiencies and increase the envi- 
ronmental performance [Man14]. In summary, the benefits resulting from a joint operation 
of Coupled Electric Power and District Heating Networks (CEPDHNs) and their markets are 
well documented [ZWW* 21, WYJ*16, LSF14, DLS*19]. 


Within every price zone. 

Including feed-in management, countertrading as well as procurement and usage of network reserves. 

Besides MES, further terms used in the same context are integrated energy systems [WYJ+ 16], multi-carrier 
energy systems [CWW? 18a], and sometimes energy internet [ZLGZ17]. 

These two forms of operation are also known as following thermal load or following electric load in the literature, 
see e.g. [LWW18]. 
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Based on the above stated challenges in CEPDHNs, the following beneficial properties can 
be deduced to achieve a technically efficient and economically optimal operation of future 
CEPDHNs: 


1. The ability to coordinate the vast rising number of flexible network participants in 
EPNs and DHNs spatially and temporally in real-time. Thereby, matching supply and 
demand while ensuring secure? CEPDHN operation and keeping the necessary grid re- 
inforcements as small as possible. 


2. Technical efficiency is to be increased. Especially, a form of DHN operation with low 
losses is to be named in this context. 


3. Market and control mechanisms are to be designed jointly in order to interact optimally. 
For that matter, inefficiencies as uplift costs stemming from redispatch procedures can 
be prevented, by including operational network constraints within the market clearing 
processes. 


4. EPNs and DHNs and their energy markets are to be operated in a coordinated form, 
in order to make use of the full gain of technical, economic and environmental perfor- 
mance. 


1.2 State of the Art 


To face the interdisciplinary context of the presented work, four different fields of research 
spanning optimal operation of CEPDHNs are stated here. It should be noted, that these re- 
search fields partly overlap, since they all deal with the same aim of optimizing FNPs in 
CEPDHNs. However, the individual approaches differ largely, due to assumptions on informa- 
tion sharing between entities as network operators, market operators, and FNPs, the regarded 
form of network operation, as well as the chosen objectives as e.g. cost minimization or so- 
cial welfare maximization. The first group of papers tackles the cost minimizing operation of 
CEPDHNs. These approaches model cost minimizing scheduling and dispatch as performed by 
system operators. The second group of papers focuses on distributed operation approaches for 
CEPDHNs with the aim of enabling real-time implementation of large optimization problems 
through parallelization and/or protection of confidential information of system operators run- 
ning connected and interacting systems. The third field of interest considers approaches for 
market-based operation of CEPDHNs. These papers focus on the market aspects and mech- 
anisms relevant in the context of energy markets. The fourth and last cluster of the state of 
the art describes the most relevant and recent work within the field of Transactive Control 
(TC). The domain free concept of TC brings together market and control mechanisms to attain 
global objectives within energy system operations. Finally, the last part of this section gives 
a discussion of the content of the presented literature and describes the existing research gap. 
This comprises the missing full integration of market and control mechanisms, the insufficient 
CEPDHN modeling detail for efficient operation, and the lack of scalability of most optimal 
CEPDHN operation approaches. 


8 All network states are within operational boundaries provided in Section 3.3.1. 
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1.2.1 Cost Minimizing Operation of CEPDHNs 


The approaches presented within the section have been developed for cost minimizing schedul- 
ing and dispatch as performed by system operators. In this context, market mechanisms as 
e.g. different forms of pricing which are necessary in deregulated markets, are neglected. The 
operations mostly differ by the used CEPDHNs model, which lead to diverse classes of opti- 
mization problems solved by different methods. The following works are characterized by a 
high technical detail in comparison with the ones outlaid in the other three following subsec- 
tions. 


The authors of [GA07] identified the need for MES modeling and operation early and presented 
relevant work in the field of optimal dispatch of MES. Therein, they used purely stationary 
network models and the energy hub concept. This concept is also applied by the authors of 
[BHH™ 12] to provide DSM’. Herein mathematical models for different household devices and 
their respective demands are presented. These are used to formulate the optimization problem 
of a residential micro hub, with which different objectives as e.g. cost minimization or emis- 
sion reduction can be pursued. The overall optimization problem of the residential micro hub 
is thereby formulated as a Mixed Integer Linear Programming (MILP) problem. The approach 
is demonstrated in simulations and with real prototypes. In this work, the heat loads are solely 
supplied by household devices. Energy hubs are a possible form of structuring models of enti- 
ties as e.g. distribution networks, facilities or dwellings. Typically the power flows within the 
energy hubs are modeled as lossless and the power conversion between different energy car- 
riers are modeled by conversion efficiencies. As this concept neglects operational constraints 
of the multi-carrier networks within the hubs and creates modeling overhead in the context 
of this work, it is not further regarded here. 


An approach for the heat and power dispatch ina CEPDHN is proposed in [LWS* 15]. Thereby, 
the operation costs of CHP units, of thermal plants, and the curtailment of wind power is min- 
imized. The EPN is modeled based on a Direct Current (DC) power flow model, neglecting the 
reactive power flows and voltage magnitudes of real Alternating Current (AC) operation. The 
pressure losses within the DHN are calculated based on constant friction factor coefficients 
within the Darcy-Weisbach equation. Also, loops within the DHN are neglected, as no con- 
straint is used to fix the pressure drops within a loop of the network. Mass flows throughout 
the network are modeled as being variable, whereas the mass flow direction remains fixed. 
To represent the thermal dynamics of the temperature fronts within the DHN, the authors 
base the thermal pipeline model on the node method [Ben91], which is presented in detail in 
Section 2.3.3. This results in a Mixed Integer Nonlinear Programming (MINLP) problem. To 
circumvent the MINLP, the authors propose a decoupled approach, where the complicating 
variables!” are determined based on the results of the previous optimization. The solution is 
then obtained by several iterative optimizations and recalculations of the complicating vari- 
ables. The authors assure, that this procedure shows good convergence in practical applica- 
tions, even though a proof of convergence is still an open field of research. Information on 


? An overview on the different forms of DSM, as energy efficiency, time of use, demand response, and spinning 


reserve is found in [PD11]. 


10 These are integer variables here. 
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necessary Central Processing Unit (CPU) time for the calculations is not given. However, this 
work shows, how the storage capacity ofthe DHN pipelines can be used effectively to increase 
the economic efficiency of the entire CEPDHN operation. 


The MINLP problem from [LWS*15] is reduced to a MILP problem in [LWW*15] by as- 
suming a constant flow and variable temperature control (CF-VT) operation form. This ap- 
proach is used to obtain the cost minimizing Unit Commitment (UC) solution of the regarded 
CEPDHN for different problems. These are a pure deterministic UC calculation of the entire 
CEPDHN, a separate master slave optimization ofthe EPN and the subsequent DHN optimiza- 
tion based on benders decomposition, and a robust optimization problem, which enables to 
take uncertainties of the wind power infeed into account. 


A further unit commitment approach for optimal operation of a CEPDHN is presented in 
[GWL*17]. In this work, the thermal inertia of buildings is also used to lower the operation 
costs of the CEPDHN and to achieve a higher utilization rate of the wind power. Therefore, 
dynamic models are introduced to considered the thermal storage and loss of the buildings. 
The proposed MINLP problem approach is also based on the Constant Flow and Variable Tem- 
perature (CFVT) control mode assumption for the DHN and the EPN is modeled solely by a 
real power balance equation, omitting any further constraints as e.g. flow constraints. A case 
study of a real world radial CEPDHN is performed to show the functionality of the approach. 
CPU calculation times are not given. 


In [WGJ* 17] the fuel cost minimizing scheduling of a CEPDHN is performed by solving a 
MINLP. For that matter, the optimal interaction of CHPs, EBs, Thermal Energy Storage Systems 
(TESSs), and consumers is pursued. The authors describe the presented approach as a form of 
Model Predictive Control (MPC). The DHN is operated by the CFVT control strategy. Hence, all 
mass flows, incorporating their flow directions, are defined in advance while the temperatures 
are dependent on the MPC control signals. The EPN is modeled by linear power balance and 
flow constraints. 


An integrated heat and electricity dispatch model is developed in [ZZZW18b], and imple- 
mented to minimize the daily operation cost as well as the wind power curtailment in the 
CEPDHN. The DHN pipelines are modeled based on the node method. The DHN is operated 
based on a special CFVT form, where the flow can be varied in advance for different time steps. 
The EPN is represented by a linear real power balance equation. Based on the aforementioned 
simplifications, the overall dispatch optimization problem is reduced to a large scale linear 
programming problem. This approach was extended in [ZZZW 18a], by taking into account 
variable mass flows and the possibility of utilizing the thermal building inertia. As the auxiliary 
variables necessary for the node method seem to be predetermined in some way, the problem 
still remains a large scale linear programming problem. No information on the accuracy of 
the proposed models is given. Also the flow directions in the pipelines of the DHN are fixed, 
which is surprising, due to the variable flow control and the amount of producing units in the 
case study. However, the paper gives a good overview on the basic forms of DHN operation. 


The nonlinear unit commitment problem solved in [LWW 19], with nonlinear constraints, 
is approximated to obtain a Mixed Integer Quadratic Programming (MIQP) problem. This is 
then solvable in a few seconds for a simple test system and within 15 minutes for larger test 
systems, considering uncertainty. However, no information of the model accuracy, e.g. by 
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giving a comparison of the model output with measurement data is given. Further work with 
similarities to the above mentioned is found in [ZLZ* 19, YCC* 19]. 


A good overview on the modeling and solution methods for operational optimization of 
CEPDHNs, thereby named the Integrated Electricity and Heat System (IEHS) is given in 
[ZWW* 21]. Important conclusions, which are given in this paper and concur with the analysis 
of the author of this work are: First, “the electrical, thermal, and hydraulic processes are tightly 
coupled in the IEHS, leading to a large computational burden for the integrated energy flow 
calculation”; second “nonlinear terms or non convex feasible region caused by device charac- 
teristics, network constraints, and optimization under uncertainty make the original problem 
computationally intractable”; third, “the time delays and thermal dynamic characteristics in 
the pipelines of the DHS are non-negligible”. 


The central assumption which strongly facilitates the original problem of efficient DHN, and 
thereby also CEPDHN, operation comprises a constant mass flow [HTWL19]. By consequence, 
this brings along a second assumption which is typically not valid in efficient DHN operation: 
Mass flow directions are predetermined before solving the optimal operation unit commitment 
or dispatch problem. This fundamental aspect is explained in the following Remark. 


Remark 1.1: 


As soon as more than one point of heat power infeed exists or the DHN has a meshed structure 
within the supply or return network? Varying Mass Flow Directions (VMFDs) can occur 
during network operation [Opp15, p. 75]. This is due to the fact, that the flow directions on 
DHN edges is dependent on valve and pump operation set points in DHNs, and these set points 
are varied by the network operators, producers and consumers. 


To the authors knowledge, the only two approaches published, which do not use these assump- 
tions for optimal CEPDHN operation are found in [Tr699, HTWL19]. In [Tr699] an approach 
for the optimal dispatch of the producers of a DHN operator is presented. The chosen objective 
is to minimize the necessary energy purchase. Thereby, the interaction with the EPN is re- 
garded to model the amount of produced electricity to enable economic assessment of different 
solutions. The approach enables to incorporate the storage capabilities of the DHN pipelines 
while regarding multiple producers at different locations within a meshed network. To repre- 
sent the temperature dynamics in the case of VMFDs a pipeline model based on the linear in- 
terpolation of node temperatures as in [Ben91] is presented. However, this approach assumes 
a uniform flow direction for the entire prediction horizon, which creates deviations of the 
pipeline outlet temperature, when this assumption is not fulfilled. Necessary integer variables 
are approximated by continuous variables, utilizing additional nonlinear constraints. Also not 
continuous differentiable constraints, as e.g. with absolute value operators, are approximated 
by nonlinear continuous differentiable approximations. To reduce the computational burden 
of the proposed approach, stationary DHN models are used to calculate initial solutions. The 
non stationary thermal variables of the stationary solution are then recalculated based on a 
dynamic simulation model. The resulting values are then utilized as the starting points for the 
overall Nonlinear Programming (NLP) problem. 


11 District Heating System (DHS). 
12 DHNs are typically constructed symmetrically. However, it is important to note that the meshes occur within the 
supply or return network as, when taking both network parts into account, every DHN is of meshed structure. 
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The approach in [HTWL19] is proposed for economic dispatch of a CEPDHN, where 
VMFDs are taken into account in the DHN. Therefore, first a complex non-convex 
MINLP model is established, which is then approximated by a Mixed Integer Conic Program- 
ming (MICP) problem. This new convex model problem can then be solved efficiently by 
standard of the shelf solvers. The initial nonlinear model is of stationary form and thus disre- 
gards the propagation of the temperature fronts through the DHN pipelines. Also the friction 
factor in the Darcy-Weisbach equation is modeled by a constant coefficient, which is a strong 
assumption as will be shown in detail in Section 2.3.2. Further, if storages are charged or dis- 
charged has to be defined before the optimization, as this defines their outlet temperature. 
The EPN is modeled by a DC line flow model. Determining the accuracy of the proposed 
approximated model is left for future work. 


1.2.2 Distributed Operation of CEPDHNs 


The literature summarized within this section is based on multiple distributed controllers op- 
erating CEPDHNs. Note, that in this work the terms distributed and decentralized, are 
defined as follows”. 


Definition 1.1 


A distributed control approach contains multiple local controllers which share informa- 


tion, while no centralized authority is in charge for this task. In contrast to that, decen- 
tralized control comprises subsystems, which are controlled independently by not com- 
municating controls [Lun14a]. 


The motivation for distributed operation approaches typically comes from at least one of the 
following five reasons: First, the large number of FNPs, needs parallel computation in order 
to solve the resulting large scale optimization problems. Second, the burden of communi- 
cation increases with larger distance and amount of the individual entities. Third, a central 
control unit would need frequent redesign, as a change in a single element would require 
adaption. Fourth, information exchange may be nontrivial due to unwillingness! or lack of 
means, also aspects of cybersecurity become more relevant if data is accessible at many dif- 
ferent points. Fifth, a central controller is more vulnerable, due to a single point of failure 
[YMS14, MDS* 17]. 


Early work in this field was published in [GHVO96]. Therein, the heat and power dispatch are 
performed in two sub problems, which are coupled through the feasible region constraints of 
possible heat-power production of the co-generation units. Through the exchange of informa- 
tion the two sub problems converge to the global solution. As well the EPN and the DHN are 
represented by power balance equations. 


13 Throughout the literature concerning the optimal operation of CEPDHN, the terms distributed and decentral- 


ized are used by different authors describing the same ideas. This results from the fact, that different criteria, 
as e.g. demand for communication or the location of necessary hardware, is utilized to decide if an approach is 
decentralized or distributed. Within this work we use the definitions coming from the control theory background 
[Lun14a]. However, this definition is also used frequently in power engineering, see e.g. [YMS14]. 

14 For example, the EPN and the DHN can belong to different operators [ZWW* 21]. 
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In [Arn11] a Distributed Model Predictive Control (DMPC) approach is presented to solve the 
optimal dispatch of energy hubs in different control areas. The power and gas networks be- 
tween the hubs are represented by stationary models as in [GA07]. Heat flows and the system 
dynamics representing storage devices are considered only within the hubs. The Optimality 
Condition Decomposition (OCD) approach is used to decompose the global dispatch problem 
into a distributed multi-area optimization problem. 


In [LFZC16] a new nonlinear CEPDHN dispatch model is presented together with a new dis- 
tributed algorithm for the calculation of the optimal solution of the distributed dispatch of the 
DHN and the EPN. The EPN model is based on the accurate AC power flow model. How- 
ever, the DHN model uses several new component models, while a validation of the model is 
missing. The general convergence properties of the developed distribution approach are not 
given. 


A combined heat and power ED approach is given in [LWZS17]. Based on a constant mass 
flow and constant load assumptions for the DHN and a DC power flow model the overall ED 
problem can be formulated as a Quadratic Programming (QP) problem. The central problem 
is solved in distributed form by the DHN and EPN operators using benders decomposition. In 
every iteration, the EPN operator will calculate boundary variables, by performing an opti- 
mization, and communicates these to the DHN operator. Then, the last mentioned calculates 
the optimal DHN dispatch, based on constant boundary variables. These results are then used, 
in different forms in case of feasibility or infeasibility of the DHN dispatch, to initialize the 
next iteration of the EPN dispatch. Based on this, the solutions converge to the same solution 
as the central problem. The authors show, that the benders decomposition performs better 
than the Alternative Direction Method of Multipliers (ADMM) in their case study. However, 
the central problem calculation converges faster in the large scale problem in the presented 
simulations. This could arise from the fact, that benders cuts can offer few information on the 
central problem, which can result in weak convergence properties [LGZ* 19]. 


The contributions of [HLW17] are threefold. First, the coordination framework for a 
CEPDHN is proposed with multiple DHNs and a single EPN, with their respective opera- 
tors. Second, a convex economic dispatch optimization problem for the overall CEPDHN is 
formulated. Third, a distributed solution scheme, based on Optimality Condition Decompo- 
sition (OCD) is introduced. For that matter, the EPN and DHN operators communicate real 
power flow values over the tie lines, the phase angles of their respective buses and the La- 
grange multipliers of the complicating constraints. The decomposition over electric tie lines 
has already been performed before, e,g. in [Arn11]"°. As the central ED optimization problem 
is convex, convergence of the OCD procedure is guaranteed. However, the convexity is only 
achieved, by assuming constant mass flows and a DC power flow model. 


The distributed optimization in the following papers [XWZ+19, LGZ+ 19, TWW* 20] is based 
on the Alternative Direction Method of Multipliers (ADMM). All of these papers use the 
constant mass flow operation form for the DHN operation. The EPN models are based on 
linearized AC branch flow models [XWZ* 19], real power balance equations [LGZ* 19], and 
a DC power flow model [TWW* 20]. The entire non-convex MINLP CEPDHN scheduling 


15 Herein, different variables are shared among the areas, due to a slight different formulation of the problem 
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problem proposed in [XWZ* 19] is reformulated as a Mixed Integer Second-Order Cone Pro- 
gramming (MISOCP) by replacing the nonlinearities by approximations. This problem is then 
decomposed into sub problems using the ADMM approach. To avoid the non convexities 
coming from the remaining integer variables, the MISOCP sub problems are then solved by 
further decompositions. The authors of [TWW* 20] performed multiple optimizations with 
different time step intervals in order to understand the computational impact of this param- 
eter choice. Based on their calculations, they propose 30 to 20 min as a good time interval 
for their multi period optimal CEPDHN dispatch, solved with the ADMM parallel compu- 
tation approach. In [TWW* 20] a Locally Adaptiv ADMM (LA-ADMM ) approach is intro- 
duced to improve the convergence properties of the basic ADMM algorithm. No information 
is given on the accuracy of the proposed models used in the three previously discussed papers 
[XWZt19, LGZ+19, TWW* 20]. 


1.2.3 Market-based operation of CEPDHNs 


The presented works in the following focus on the economic issues arising in optimal coordi- 
nation for CEPDHN operation. Thereby, game theoretic methods, emerging market equilibria, 
arrangement of pricing mechanisms, and the interplay of DHN and EPN market operators are 
designed and analyzed. 


Aggregators are envisioned in [SDWS17] to supply consumer heat and power demand at low 
prices. Therefore the aggregators are enabled to adjust the consumers demand'® in order to 
minimize the energy purchase costs. Further it is assumed, that the entire CEPDHN is operated 
by a single Independent System Operator (ISO). The ISO maximizes the social welfare based 
consumer and aggregator bids. The entire energy dispatch, modeled as two-level optimization 
problem, is analyzed in case studies showing the efficient integration of wind power through 
flexible demand. The authors assume constant supply temperatures and variable mass flows, 
using a stationary DHN pipeline model and the EPN is modeled as a single node by a power 
balance equation. 


The energy trading market equilibrium in a CEPDHN is determined in [CWL*18]. Opti- 
mization problems are developed for the analysis of the market impact of strategical behav- 
ior of producers and flexible consumers. The power distribution network market is cleared 
based on an AC flow model, which takes losses into account. For the DHN market clearing a 
CFVT DHN operation mode is used. 


Similarly, in [LWM* 18] a mathematical program with equilibrium constraints is introduced 
to analyze the strategic behavior of energy hubs in deregulated day-ahead heat and power 
markets with game theoretic methodology. In this context, the authors propose to use the 
pay-as-bid pricing method. The DHN model is based on a linear thermal flow model resulting 
from the constant mass flow assumption. The EPN representation is based on a linearized 
branch flow model. 


16 Also known as Direct Load Control (DLC) [PD11]. 
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The parallel distributed dispatch of aDHN and an EPN, which are coupled to a CEPDHN is 
presented in [CWW*18b]. The optimal thermal flow problem of the DHN incorporates vari- 
able temperatures and variable flows. Also VMFDs can be represented in the model, but not 
within the DHN dispatch. The market driven approach presented, determines the prices, here 
Locational Marginal Prices (LMPs), by which the EPN and DHN operators sell heat or power 
to the other operator. Also the electric and heat power production of CHPs and HPs, owned 
and operated by either ofthe two operators, is determined in this fashion. Due to convergence 
problems, the authors utilize a continuous LMP demand curve approximation to overcome oc- 
curring oscillations. The approach exchanges similar information between the two network 
operators as the OCD approach in [HLW17], but the complicating constraints are not relaxed 
to the objective functions of the other operator”. Thus, this additional information, used to 
calculate the search direction, which is used in the OCD approaches, as depicted in detail in 
Section 3.3.2, is left out here. 


In [DLS*19] the Locational Marginal Pricing Approach (LMPA), which has been extensively 
studied and used for electric energy markets is extended to heat markets. More detailed, the 
effect of transmission delay of DHN pipelines on the LMPs is analyzed. The authors conclude, 
that the LMPA can be also used for DHN pricing, advancing its well known benefits to the 
entire CEPDHN. The authors use a constant flow assumption for the DHN within their work. 


The work in [MKP20] and [ZH21] propose a sequential clearing of the heat and power mar- 
kets. In [MKP20] the heat market optimization problem takes the electricity market clearing 
into account, in order to obtain a high level of coordination in the clearing of the two inde- 
pendent operated markets. The authors developed this approach as a trade-off between state 
of the art uncoordinated market clearing and a fully integrated heat and power market, which 
would need very strong adaption of jurisdictions based on the authors estimate. The decom- 
posed clearing is achieved by utilizing the benders decomposition. Based on case studies, the 
authors show, that the stronger market coordination enables a maximization of RESs power 
infeed. In contrast to this, the authors of [ZH21] propose to clear the power market before the 
DHN operators decide on their optimal schedule. Therein, price incentives are used to moti- 
vate the DHN operators to fully exploit the pipeline storage capabilities. The optimal thermal 
flow problem used for the DHN optimization is based on the CFVT operation mode. 


The approaches presented in the first three fields of literature above, bring along a stronger 
focus on either the technical operation or the market mechanism design. An approach that 
regards both aspects in an integrated form is TC. 


1.2.4 Transactive Control 


This section, presents the most relevant literature in the field of TC. In the context of the 
aforementioned challenges, see Section 1.1, neither control nor market mechanisms alone can 
provide the essential basis for efficient economic and secure? CEPDHN operation. In this 
context, the concepts of Transactive Energy (TE) and TC have been developed [KW16]. These 
are defined as: 


17 Even though the Lagrange multipliers, here named LMPs, are used within the objective functions of the opposed 


network operator. 


12 1 Introduction 


Definition 1.2 


Based on [Cou15], TE is “a system of economic and control mechanisms that allows the 
dynamic balance of supply and demand across the entire electrical infrastructure using 
value as a key operational parameter.” 


Definition 1.3 
The concept of TC [LLFZ20] is “a domain-free approach that integrates market-based 


coordination and value-based control for a group of resources to achieve certain global 
objectives.” 


Thereby, value is usually understood as market price [LLJZ20]. In this sense, TC enables, 
optimal coordination of FNPs while considering privacy'®[KW16, LLJZ20], overcoming the 
disadvantages of earlier concepts such as direct load control and price-responsive control, as 
the former does not consider user preferences and the latter lacks predictability of the load 
response [LLJZ20]. When TC is applied to an EPN, it is usually referred to as a TE system 
[LLJZ20], studied in a large number of papers, as summarized in [LLJZ20, ALFV19, LWHZ17]. 
As stated in [LLJZ20] TE, and therefore also TC, is characterized by: “the following distinctive 
features”: 


1. The class of approaches achieves end users participation and engagement “through 
smart energy management systems”. 


2. TE enables scalability of the system. 


3. The framework provides “control signals that coordinate self-interested users to achieve 
system-level objectives while respecting power system constraints”. 


4, Within TE market interactions coordinate supply and demand sides. 


These features distinguish TC approaches from the three aforementioned fields of research 
for optimal CEPDHN operation (cost minimizing operation, distributed operation, and market- 
based operation). Still, some of the distributed operation approaches presented in Section 1.2.2 
try to provide scalability and most of the market-based operation approaches discussed in 
Section 1.2.3 take bidding consumers into account. But none of the presented approaches of 
the aforementioned fields brings together all of these distinctive features. 


Due to the fundamental difference of the underlying physics, in network operation of EPNs and 
DHNs, such as relatively slow propagation of energy and the potential to store energy within 
DHNs, it is not possible to apply TC approaches developed for EPN operation to DHNs. Fur- 
thermore, as opposed to TC for EPNs, TC approaches for CEPDHNs have not been fully 
studied, as the application of TC techniques to multi-energy systems is relatively new. For 
example, in [BCDC18], thermostatic loads of heat pumps and air conditioners are operated 
based on the TC paradigm, while maintaining comfortable temperatures. A TC modeling and 


18 The aspect of privacy regarded here is [KW16]: “the approach protects the end user’s privacy as the bids com- 


municate only information about energy quantities and prices.” 
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assessment framework for distributed multi-energy systems is presented in [GCHM19]. The 
authors of [WJH* 19] propose a double auction retail market framework to enable optimal sup- 
ply and consumption with electricity and heat. A form ofthe ADMM is used in a TC system 
to coordinate the distributed energy sharing among multi-energy micro grids in [YHA 20] 
and [XZL*20]. A double stage stochastic approach, which allows thermal energy storages of 
buildings to manage the uncertainty resulting from energy procurement in a TC context, is 
reported in [YP21]. Finally, a TC approach based on peer-to-peer transactions in the context 
of multiple energy hubs, with multiple energy carriers and high infeed of RESs, is discussed 
in [GYYW21]. 


However, these papers do not discuss issues associated with market-based operation that con- 
siders the relevant physical aspects of efficient CEPDHNs operation. In general the presented 
TC papers use very simple CEPDHN models, mostly neglecting thermal flows within the 
DHNs. 


1.2.5 Discussion and Research Gap 


A discussion of the above presented literature and a derivation of the research gap thereof is 
provided within this section. 


Existing models for optimal operation of CEPDHNs suffer from unjustified simplifications. 
The following assumptions are questionable in real world examples: 


« The operation form of the DHN guarantees constant mass flows. Thus these are known 
before the optimization and the hydraulic models do not need to be incorporated into 
the optimization problem as hydraulic and thermal models are independent [ZWW* 21]. 


« Friction factors in the Darcy Weisbach equation, describing the pressure loss within 
DHN pipelines are modeled as parameters. This assumption is valid if the mass flows 
are constant [LWZS17] and thus predetermined. However, this model is also widely 
found when flows vary during the operation. In the latter case, the pressure difference 
calculation of the components becomes very inaccurate, see Section 2.3.2. 


« Varying Flow and Constant Temperatures (VFCT) DHN operation mode is used. There- 
fore, potential heat loss reductions and temperature storage in DHN pipelines are ne- 


glected. 


¢ The mass flow directions within the DHN are fixed and known in advance. However, 
this assumption is invalid as soon as more than one point of heat power infeed exists 
or the DHN has a meshed structure within the supply or return network’, also see 
Remark 1.1. Thus this assumption is invalid for most real world DHNs. 


« DPRs, pumps and their respective control paths are not incorporated into the hydraulic 
DHN models. Hence, the pressure differences over the components and the mass flows 
become inaccurate, which then also impact the thermal variables. 


e Stationary thermal pipeline models are used in DHN models. 
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Figure 1.1: Example DHN with four nodes, two consumers and two producers. 


e A radial and lossless DC EPN model is used. These assumptions help to avoid nonlinear 
and non-convex AC power flow equations. Still, electric distribution networks line losses 
should be taken into account [CWL+18] and meshed structured distribution networks 
exist as well. 


Using the aforementioned simplifications enables to avoid non-convex and nonlinear con- 
straints and integer variables within the optimization problems. However, not considering 
relevant physical effects may have severe consequences on technical efficiency and the mar- 
ket outcome. Exemplary direct consequences of the assumptions above on technical efficiency 
and market clearing are: 


e Constant mass flow: In this case the valves and pumps are all modeled as operated at 
predefined set points and therefore for example a consumer can not increase its power 
consumption, as the maximum power consumption is defined by the supply network 
temperature and the fixed mass flow passing through the heat exchanger of the con- 
sumer. Similarly, this limits the possible variation of heat power supply of the produc- 
ers. This does not only prevent ideal coordination of supply and demand for example 
through DSM, but it also has a large impact on the technical efficiency of the DHN as 
explained in [MTK™ 22, pp. 6-7]. Heat losses mainly occur in DHNs, based on the heat 
flow through pipeline insulations. As heat losses increase with rising difference between 
the fluid and the ambient temperature, these can be minimized by keeping the tempera- 
tures as low as possible [ZLG13]'?. Therefore, DHN operators aim to set the mass flows 
through the heat exchangers of consumers and producers such that the temperature dif- 
ference between supply and return network is maximized, and thereby the mass flows 
and the resulting pump costs are minimized [ZLG13]. As heat losses are in the range 
of 12% to 20% [VSLD13, CYC04, LMMD10], an efficient operation based on variable 
mass flows (and variable temperatures) is of significant interest. 


1% Supply network temperatures can only be reduced to a certain level in order to sufficiently supply the heat demand 


of customers. 
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« Stationary DHN pipeline models: As stated in [ZWWt21]: “Neglecting the dynamic 
characteristics of the DHS may result in an infeasible or suboptimal solution.””’ As will 
be demonstrated in Section 4.2.1 the storage potential in DHN pipelines can increase 
the flexibility of the entire CEPDHN and thus help to increase the social welfare as 
heat is fed into the DHN during time of low priced heat supply and then consumed in 
the following time steps with higher energy prices. Besides, this flexibility can help to 
prevent RESs curtailment [ZZZW18b], which also increases technical efficiency. 


e Constant flow direction: Regarding Figure 1.1 using a model with fixed flow directions 
would prevent the ability of Producer 2 to provide Consumer 1 with heat power. Trans- 
ferring this aspect to larger DHNs with more FNPs makes it apparent how severe the 
market outcome can be affected through this modeling decision. Besides, once more this 
model simplification can affect the technical efficiency, as due to this assumption, hot 
water might flow longer distances from producers farther away to specific consumers, 
creating higher heat losses. 


None of the presented papers presented in the previous Sections 1.2.1 to 1.2.4, addressed the 
full necessary technical detail needed to achieve technical efficient and economic optimal 
CEPDHN operation. Thus, the second beneficial property, stated in Section 1.1, is so far not 
fulfilled within the state of the art. 


Remark 1.2: 


As discussed here, the optimization problem for market-based operation is either described by a 
significantly simplified convex model or by an accurate non-convex model. Based on the afore- 
mentioned, one cannot guarantee in practice finding the Pareto optimal solution for the real prob- 
lem. When referring to economic optimal solutions in this work, this always refers to a welfare 
maximizing solution of the given optimization problem. If this is obtained by a non-convex op- 
timization problem, it should be kept in mind that this solution does not have to be the Pareto 
optimal solution, as it could represent a local optimum. 


Further, on the one side the more technical work presented in Section 1.2.1 and 1.2.2 lack the 
joint design of market and operational mechanisms, as the scope of these papers is not set to- 
wards economic issues. On the other side, most of the more economically oriented approaches 
presented in Section 1.2.3 and 1.2.4 cannot guarantee optimal spatial and temporal coordina- 
tion of the FNPs as well as secure network operation®, due to the strongly simplified network 
models. Therefore, the third beneficial property, deduced in Section 1.1, is not reached in the 
current literature. Still, market and control mechanisms have strong mutual interdependen- 
cies. Just to name a few, for example, pricing mechanisms will affect the Market Participants 
(MPs) bidding behavior, and thus the amount of power dispatchable at a certain point of time 
and a certain location. Further, defining prediction horizons and time step intervals in TC ap- 
proaches, will directly impact the bid structures, the dispatch results and thereby also again 
the market prices. Also several interrelations of market and control mechanisms, explained in 
detail in Chapter 3, can on the one side limit the applicability of certain approaches, and on 
the other side increase the performance of the Transactive Control System (TCS) if adequately 
employed. Therefore, designing these market and control mechanisms in a joint coordinated 
process is a key element to achieve technical efficiency and economic optimality at the same 
time. 
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Distributed operation approaches, can help to overcome the computational burden of opera- 
tional optimization of large CEPDHNs with numerous FNPs and hence enable scalability. A 
large amount of literature is found, proposing approaches for the distributed optimization of 
EPNs, see [MDS* 17] for a review. However, so far the proposed distributed CEPDHN opera- 
tion approaches, stated in Section 1.2.2, only decompose the CEPDHNs along EPN tie lines or 
the energy converters between DHNs and EPNs. The decomposition within DHNs is still to be 
performed. To the best of the authors knowledge the only approach provided so far is based on 
a MILP optimal DHN operation model [KMHG21]. Thus the authors of [ZWW* 21] stated this 
as future work: “In solution methods for decentralized optimization, decomposition scheme 
suitable for more complex coupling constraints need to be exploited”.”° Note, that a clear mo- 
tivation for distributed DHN operation approaches arises from the high computational cost 
of detailed DHN models [ZWW* 21], as well as the simulation results from large real world 
DHNs, in Chapter 4. 


To overcome the challenges stated in Section 1.1 it is of high interest that future CEPDHN op- 
eration approaches enable scalability, ensure secure network operation, coordinate FNPs in 
EPNs and DHNs spatially and temporally, prevent technical inefficiency, and provide market 
and control mechanisms that interact in a joint concerted form. Thus the research gap, 
defined by the deviation between these beneficial properties to the status quo and the current 
literature can be summarized as follows: 


Research Gap: 


1. Market and operational control mechanisms have so far not been fully integrated 
for optimal coordination of FNPs in CEPDHNs. 


a) The necessary technical modeling detail for efficient CEPDHNs operation, is 
not reached within the state of the art on model-based CEPDHNs operation. 


b) The technical modeling detail directly impacts the market outcome. This 
aspect has not been sufficiently addressed within the state of the art on 
CEPDHN operation. 


2. So far the proposed distributed CEPDHN operation approaches only decompose the 
CEPDHNs along EPN tie lines or the energy converters between DHNs and EPNs. 
The decomposition within DHNs is still to be performed. 


20 Note, that the authors definition of decentralized, corresponds to the definition of distributed used within this 


work. 
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1.3 Research Objective and Statement of Contributions 


In order to bridge the outlaid research gap, the objective and main contribution of this thesis 
is: 


Contribution 1: 
The design of a new TCS for CEPDHNs. Thereby, bringing together market and control 


mechanisms in a form that enables a technically efficient and secure? operation for future 
CEPDHNs. Additionally, the proposed TCS enables parallelization of computations by 
applying a distributed optimization approach. 


The contributed approach is designed based on a TC framework as the aforementioned is 
best suited to provide the beneficial properties listed in Section 1.1. This is due to the fact, 
that distinctive features of TC approaches are the ability to coordinate supply and demand 
through market interactions, while providing control signals coordinating large numbers of 
FNPs to respect energy system operation constraints, enabling scalability and additionally pro- 
viding salient features as privacy preserving information exchanges of smart energy manage- 
ment systems [KW16, LLJZ20]. Still, different TC approaches can vary strongly, see [LLJZ20]. 
Therefore, Contribution 1 comprises the definition of entities and their respective information 
exchange, the design of complementary market and control mechanisms, and the embedding 
in ambient control loops existing in EPNs and DHNs. As the chosen control mechanism is a 
distributed optimization based rolling horizon implementation, an important design criterion 
is the selection of an appropriate distributed optimization approach for NLP problems. Contri- 
bution 1 is presented in Chapter 3 and its application is demonstrated in Chapter 4. Note, that 
the central Contribution 1 is build upon two further contributions stated below, as depicted 
in Figure 1.2 showing the relation of the four contributions of this work. Within this TCS ap- 


Contribution 2 


| Contribution 2 Contribution 4 
Contribution 3 Contribution 2 


Figure 1.2: The relation of the four contributions of this thesis. Contribution 1 is built upon Contributions 2 and 3. 
Further, Contribution 4 is also based on Contribution 2. 


proach, an adequate model of the CEPDHN is of high relevance in order to guarantee secure® 


and efficient CEPDHN operation based on calculations that can be performed at runtime. 
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Thus the second contribution of this thesis is: 


Contribution 2: 


The composition of a novel detailed CEPDHN model for operational optimization. This 
model avoids the questionable simplifications discussed in Section 1.2.5. 


The tradeoff between computational burden and exactness of representation of physical effects 
lead to a nonlinear non-convex model, in which several variables are approximated by param- 
eters which are adequately precalculated. While for several components of the CEPDHN the 
selection of an adequate model is performed by using models based on existing literature, a 
quantitative and qualitative comparison of existing dynamic thermal DHN pipeline models 
performed by the author in [MRMH21] showed that no DHN pipeline model fully suits the re- 
quirements. In this context, the main requirement is a high model accuracy as pipelines are the 
most common components and therefore imprecise models can lead to significant subsequent 
errors. Besides, the ability to take into account pipeline storage through dynamic models and 
the potential to incorporate VMFDs are important. Last but not least, the computational cost 
is to be kept limited. The newly developed dynamic DHN pipeline model, which is presented 
in Section 2.3.3 suits these requirements, and is designed to optimally fit within the control 
mechanisms. Furthermore, the overall CEPDHN model is able to take into account Variable 
Flow and Variable Temperature (VFVT) operation conditions with VMFDs, the dynamics of 
temperature front propagation, control of active hydraulic components as pumps, valves and 
DPRs, and the full AC power flow. Contribution 2 is presented in Chapter 2. 


Also, different pricing mechanisms are compared for their suitability for coupled 
CEPDHN market clearing within the newly developed TCS. As no existing pricing mecha- 
nism is optimally suited for the given problem, a new pricing approach was developed, thus 
the last contribution is: 


Contribution 3: 


A new hybrid pricing based mechanism for coordinated CEPDHN market clearing, in 
order to facilitate incentive compatibility while preventing uplift costs from redispatch. 


A detailed description of this approach is given in Section 3.2.3. Further, note that simu- 
lational results demonstrating the effectiveness of the stated contributions are presented in 
Chapter 4. 


The last contribution of this work is: 


Contribution 4: 


A distributed optimal operation approach for DHNs based on OCD. 


As described in detail in Section 3.3.2, OCD is well suited for the implementation of distributed 
optimal dispatch problems of EPNs. When applying OCD to DHNs, the symmetric structure of 
supply and return networks, and especially the representing network models are nontrivial to 
decompose into sub problems. Thus, the key challenge is to find a form of decomposition that 
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reduces the coupling between the subproblems, in order to enable the distributed approach 
to converge to the same solution as a central optimization. At the same time, the proposed 
reformulation enables to take all physical constraints into account, while preventing the elim- 
ination of all degrees of freedom of the underlying models of the small subproblems. This was 
achieved by an appropriate reformulation of the initial optimal dispatch problem for DHNs, 
developed within Contribution 2. Based on the aforementioned, the application of OCD is 
demonstrated and the limitations of the approach are discussed. The methods are presented 
in Section 3.3.2. 


1.4 Structure and Notation 


In order to provide readability and orientation, the notation and structure of this work are 
provided below. 


1.4.1 Structure 


The introduction, stated above, is followed by the three main chapters. Chapter 2 presents the 
CEPDHN model, which comprises the EPN model, the EC models, and the thermal and hy- 
draulicDHN models. Allofthese models, are optimally suited for utilization in the TCS system 
which is introduced in detail in Chapter 3. Therein the market and control mechanisms are de- 
signed in a coordinated form. This includes different pricing strategies, the control approaches, 
as well as presenting different distributed optimization algorithms. This is followed by a va- 
riety of case studies in Chapter 4, showing the practical usefulness of the newly developed 
TCS to different CEPDHNs, indicating various aspects of the market based operation as for 
example loss reduction, providing flexibility, computational burden and price signals arising 
from the selected pricing mechanism. Finally, the main conclusions of this work are drawn 
together in Chapter 5. 


1.4.2 Notation 


Matrices and vectors are written in bold symbols. For notational simplicity, the vertical con- 
catenation of (row) vectors is written as e.g. xè! = Le, x] instead of the formal correct 


form x! = [(w*)T, (a)T]". 


The gradient of function f of a stacked vector [er x] is written as V figra 2»), While the 
second-order derivative of f of x”* and x”? is written as V? fica 2a = V geb (Vaza f ). 
If not further clarified, all variables and parameters are real-valued. Complex symbols are 


written in underlined form, e.g. the admittance Y. Indices and superscripts written in italic 
form represent variable entries, while non italic superscripts represent identifiers. 


2 Modeling of Coupled Electric Power and 
District Heating Networks 


Representing CEPDHNs in adequate models for operational optimization is a complex task, as 
the characteristics of CEPDHNs bring along [ZWW* 21]: “a large computational burden and 
nonlinear and non-convex properties” Thus, the combination of suitable component models, 
representing the relevant physical effects while preserving real time computation is of central 
importance for this work. After an introduction, focusing on the main physical effects in 
CEPDHNs and the properties of the EPN, the DHNs, and the Network Participants (NPs), the 
single components will be presented. Note, that NPs include producers, consumers, storages 
and energy converters between the EPN and the DHNs. All together, these models form a new 
detailed CEPDHN model for the TCS presented in this work. 


The following Remark 2.1 helps to understand the aim of the model design and the terminology 
used within this chapter: 


Remark 2.1: 


The TCS design is based on a model-based rolling horizon?! approach. The basic idea of this 
control mechanism is to carry out an optimization, based on a dynamic system model, of the 
CEPDHNs, to determine the optimal control values. The optimization problem solved for every 
time step k takes into account all time steps on the rolling horizon k € Sy. Then the control 
values of the last optimization are sent to the controlled units, measurement data is used to update 
the system state variables, the rolling horizon time shift is performed and the optimization is 
carried out again. This procedure is continuously repeated during system operation. Since the 
presented model can also be used to simulate CEPDHNs, when the control values are entered 
as predetermined parameters, the term simulation horizon will be used in the same sense as 
prediction horizon in the following descriptions. 


The presented overall CEPDHN model enables efficient operation through high technical de- 
tail, while maintaining computability, forming Contribution 2 of this thesis. Parts of this chap- 
ter have been published in [MEKH18, MRMH21], and [MTK*22]. 


Within this work, the CEPDHN is modeled as a combination of multiple directed graphs. 
Therein, the EPN and each DHN are modeled as a directed graph. These initially separated 
graphs are coupled through ECs, which represent a subset of the NPs, connecting buses of the 
EPN and respective edges in the DHNs, see Figure 2.1. The DHN network graph elements, 
are defined by the set of all edges e € SI” and all nodes i € SH". Due to the interplay of 
supply and return networks, these DHN graphs are strongly connected”. The connectivity 
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Also known as receding or moving horizon [Arn11]. 
If only the supply network is regarded, the directed graph becomes weakly connected. 
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Figure 2.1: Exemplary network of the entire CEPDHN structure. 


of nodes 7 and edges e within a DHN is defined within the DHN node edge incidence matrix 
A‘ ” defined as?: 


1, if e is directed towards t, 
Aan =  —1, if e is directed away from i, » Vi € Sdhn e c 99” (2.1) 


0, if e is not connected to i, 


Note, that the EPN node edge incidence matrix A°P" is modeled similarly, by exchanging the 
respective sets in equation (2.1) to the set of all buses of the EPN S;?" and the set of all edges 
of the EPN, specifically S¢?”. The EPN graph spanned up by A®P® is assumed to be a weakly 
connected graph, thereby the case of multiple unconnected power grids is neglected.”* 


23 For notational simplicity and without the loss of generality, the DHN model given within this chapter is limited 
to a specific DHN, leaving aside ability to distinguish between multiple DHNs. 

24 This does not represent a major limitation of the approach as islanded micro grids represent an absolute minor 
part in the German and central European power supply, which is considered as the focus of this work. 
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Table 2.1: Signal propagation compared for different physical values relevant in CEPDHN models [I120, p. 15], 
[SGS*+ 17, p. 3015], and [Opp15, p. 25]. 


DHN 

Network type EEN Hydraulic Thermal 
Potential value Voltage Pressure Temperature 
Propagation Speed of light Speed of sound Flow velocity 
speed (~ 1.8 x 108m/s) (~ 1000m/s (~0m/s 

to 1500 m/s) to 3 m/s) 
Example distance ~ 1000 m 
Frample ~ 3.33 us ~ 0.7stols ~ 333.338 to 008 


propagation time 


The connections of NPs, which are either linked to edges in the DHNs, buses in the EPN or 
to both if they represent energy converters, are described in the bus-NP incidence matrix?” ®, 
for the EPN M°P" and the edge-NP incidence matrix for the DHN M”; 


1, ifn is a network participant connected to 7 
Mer] ParHap \ Vies "nes, (22) 
: 0, else, 
1, ifnisanetwork participant connected to e 
Mo ah en i Veesin neS, (23) 
i 0, else, 


Therein, all network participants n are accumulated in S„. Based on the above mentioned, the 
entire CEPDHN structure is defined as shown in Figure 2.1. 


An important physical aspect for CEPDHN models for operational optimization is the large 
difference in signal propagation of voltages, pressures and temperatures as stated in Table 2.1: 
Typical time step intervals of operational optimization of EPNs and DHNs , as economic dis- 
patch with elastic demand, are within the scale of several minutes [LGZ119]. By taking into 
account the propagation times from Table 2.1, it can be deduced that the EPN and the hy- 
draulic effects of the DHN can be modeled in stationary state”, while the propagation of ther- 
mal fronts needs to be represented by dynamic models, to prevent suboptimal or infeasible 
solutions within operational optimization approaches. This is a common assumption used in 
modeling of DHNs [ZWW*21]. A further important difference between DHN and EPN mod- 
els, that is given in Table 2.1 is the fact, that DHN models possess two effort variables, pressure 
and temperature, while in contrast these are only represented by voltages in EPNs. Of course, 
apart from the mentioned differences, several obvious parallels exist between the stationary 
hydraulic DHN and the EPN models, as e.g. the Kirchhoffs circuit laws are similarly repre- 


25 Note, that in general NPs could also be modeled as connected to nodes in the DHNs. However in this case the 


return network and the DHN components between the return and the supply network as e.g. heat exchangers, 
pumps, and valves, would have to be neglected. 

Note that power flows from the DHN to the EPN are not precluded by the modeling approach, but do not play a 
relevant role in the practical cases regarded here. 

Since e.g. dynamic frequency or pressure regulation are not performed in this time scale and the respective 
transient effects are thus neglectable provided adequate controls for the before mentioned. 
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Figure 2.2: Infinitesimal element of length dx of transmission line of network edge e [GECC18, p. 68]. The super- 
scripts f and t of voltages V and currents J label the two ends of the transmission line, representing from 
and to. For usual power lines, the shunt conductance G’ is neglectable [Kun93, p. 204], which is why it is 
only indicated in this Figure. 


sented within the hydraulic models, as depicted in the following of this chapter. All model 
components of the CEPDHN model for operational optimization are given in detail below. 


2.1 Electric Power Network 


This section describes the EPN model used within the TCS for CEPDHNs. The modeling of 
power flows in EPNs is a well studied field. Several well known models exist, which represent 
the power flows over transmission lines between network buses. These models differ in DC 
vs AC, transmission vs distribution, convex vs non-convex, linear vs nonlinear, limited to 
radial vs applicable to meshed network structure, and lossy vs lossless network representation, 
see e.g. [MDS*+17]. Since the energy converters, see Section 2.2, are connected to electric 
distribution networks [CWL* 18], this work focuses on electric distribution systems” within 
the CEPDHNs. The subsequent Sections 2.1.1 until 2.1.3 present the used transmission line, 
bus, and overall network model. 


2.1.1 Transmission Line 


Assuming balanced and sinusoidal steady-state conditions”, electric transmission lines, can 
be modeled as an infinite sequence of infinitesimal elements of length dz, as illustrated in 
Figure 2.2 [GECC18, p. 68]: where the parameters of the series resistance R’*°, the series 
inductance Lind’, the shunt conductance G”, and the shunt capacitance C” are all defined per 
length and per phase. 


28 Leaving electric transmission networks aside. 


2? The later can be derived from Table 2.1. 
30 Note, that indices are only provided with the respective symbols in the text, if they are of relevance within the 
explanation. 
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Figure 2.3: m-equivalent circuit of a transmission line using lumped parameters, see e.g. [Kun93, p. 207]. 


Based on the parameters, the serial impedance Z’ and shunt admittance Y’ per length and 
phase for every edge e of the set of all EPN edges S¢P” are defined by [Kun93, p. 202]: 


2 ind’ £ 
Z= R Jo a Y =G tjua Vee See (2.4) 


Based on the aforementioned, the characteristic impedance Z* and the propagation con- 
stant yP“ are calculated by[MBB11, p. 66]: 


z' 
Z [Fr P =y ZY, Vee See (2.5) 


Using lumped parameters for a given transmission line e of length Le, the simplified 7- 
equivalent circuit, as shown in Figure 2.3 can be stated, with the m-equivalent impedance 
Z? and admittance Y? given by [Kun93, p. 207]: 


Zea sinh (P3 Le), Veesem (2.6) 
Y? 1 P Le epn 
ve za tanh ( 5 J Vee se (2.7) 


Based on the aforementioned, the transmission line admittance matrix y of network edge 
e can be calculated by: 


I I 
+ Ze > 
|S Ble) + -4 
trl _ IZ ZZ epn 
Y= = F 1 fyr], VeeS (2.8) 
I I Zr 7172 
ve W lvt=0 


This transmission line admittance matrix is then used in Section 2.1.3 to set up the nodal 
admittance matrix Y ®"S describing the admittances of the entire EPN. 
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2.1.2 Bus 


Shunt admittances represent the connection of a bus 7 to the ground: 
YP =GP+jBM, vies? (2.9) 


Concatenating all shunts of the EPN into the column vector Y*" is written as: 


a ans | (2.10) 


with the cardinality of the EPN buses given by n* = |S$P"|. Also, this vector will be used in 
the following Section 2.1.3 to describe the entire EPN. 


The real and reactive power, P; , and Q;,;,, injected at bus 7 and time step k by all network 
participants n connected at this bus, is defined as: 


Pie = > MEP Paks Vie SP", bE Sp (2.11) 
nEs” 

Qie = XO ME Qn k, Vi eS, k eS, (2.12) 
a 


where the elements of the bus-NP incidence matrix M;?” are defined as in (2.2) and S com- 


prises all time steps k on the prediction/simulation horizon?!. 


2.1.3 Network 


The nodal admittance matrix Y?"® of the entire EPN is calculated by [ZMS11]: 


yes = Amy? + AP™+Ytdiag( Y) (2.13) 


where the auxiliary admittance matrices Yf and Y* are built by parameters from the transmis- 
sion line admittance matrices Y"! of the network edges as given in the Appendix A. Further, 
the incoming and leaving edge bus incidence matrices A°?™’* and AP" are defined as: 


1, if ASP? = +1 
A = Vi ES", e c Ser 
é 0, else, 
iA, =— 
an 1, if ASP" 1 sue 
AS Vi E SP, e c Sen (2.14) 
: 0, else, 


Note, that A is defined analog to Agbon in (2.1). The following property of the nodal admit- 


tance matrix Y®"S will be considered in Section 3.3.2: 


31 See Definition 2.3 for more information. 
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Remark 2.2: 


The nodal admittance matrix Y”“* is typically sparse, and the degree of sparsity increases with 
the size of the EPN network size [Kun 93, p. 258]. 


An accurate model of the meshed lossy AC distribution system is based on the nonlinear and 
non-convex’? AC power flow equations [MBB11, p. 115]: 


Pip = yo Vi, k Vj e| BES sin(5;,n — 55,6) 


jes?” 
+ GPSS cos(4i, — 6;r)], Vies, keS, (2.15) 
Qik = 5 Vi k Vj [GRIS sin(ði k — 65,8) 
Jessen 
— BP" cos(ôi k — ô;,x)], VieS?", k ESk (2.16) 


where P; k and Qi, denote the active and reactive power injected into the system at bus 7 at 
time k by all network participants n connected at this bus, as defined in equation (2.11) and 
(2.12). The conductance Gpus and the susceptance Be refer to the nodal admittance matrix 


element eee The bus voltage angles are given as 0. 


2.2 Energy Converter 


The energy converters, such as heat pumps, electric boilers or CHP units are often modeled 
by constant (efficiency) coefficients in most MES models for operational optimization, see 
e.g. [GA07]. A more detailed model, which incorporates this constant (efficiency) coefficient 
model form, is given using polynomial functions, representing the Coefficient of Performance 
(COP) or rather the coupling factor in general, as follows [Sau19, p. 108]: 


3 
Brame = XO I, germ namn m (Paeng), nM ESE", kh ES, (2.17) 


m=0 neprEgyPnce 


Therein, the (polynomial) coefficients a are € R, the polynomial order is given by m, the heat 
power output of an EC is defined by ®, and the electric real power injected (or consumed) 
is stated as P. Further, the index n representing an FNP is provided here with an EPN or 
DHN superscript to specify the connected network and the set of all network participants 
n representing energy converters connected to the DHN is given by Sdhn,ec. Note, that the 
presented model is not limited to these kind of polynomial energy converter models. More 
complex functions of the coupling factor of energy converters in MESs, as e.g. presented in 
[MSKH16] can also be included. Further, as an alternative to (2.17) descriptions using possible 
areas of operation through polygons, see Figure 2.4, which are then described by inequalities, 


32 The nonlinear and non-convex form of these equations has not prevented numerous successful implementations, 


e.g. Optimal Power Flow (OPF) problem based applications, using this exact model form [MDS+ 17]. 
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limiting possible ratios of ® to P instead of equation (2.17) can be used [DLS* 19, LWZS17]: 


Produced electric realpower P 


Produced heat power ® 


Figure 2.4: Feasible region of the operation ratio of ®,, , to P„,r of an extraction-condensing CHP unit n. 


@1,b,n Pen k + a2,b,n nann k < A3,b,n, Y n € Sahne, b E€ Sp, k E Sk (2.18) 


With the coefficients a1, a2 and a3 given for every energy converter modeled by this set of 
inequalities and the set S, is comprised of all boundaries b. These inequalities (2.18) are often 
used to model the feasible operation areas of CHPs [ZWW* 21]. 


2.3 District Heating Network 


The most relevant components considered within operational optimization of DHNs are 
pumps, pipes, valves, DPRs, storages, heat exchangers, and the connectors of pipelines, typ- 
ically referred to as nodes. Note, that producers, energy converters and consumers are only 
modeled until the heat exchanger side, directly connected to the DHNs, as usually done within 
the state of the art [ZWW=*21]. As warm water is transported from producers to consumers 
through the supply network, and back through the return network, these networks are inher- 
ently meshed. The form of implemented network operation influences the network model, 
thus the typical forms of DHN operation [ZZZW 18a] are listed below: 


« Constant Flow Variable Temperature (CFVT) operation: Thereby, the mass flows 
through the edges are kept constant, while the temperatures, especially of the water 
leaving the producers, is varied. 


« Variable Flow Constant Temperature (VFCT) operation: Therein, the mass flows are 
varied to meet changing energy demand of the DHN consumers, while the temperature 
supplied by the producers is kept constant. 
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« Variable Flow Variable Temperature (VFVT) operation: Here, mass flows and temper- 
atures through the network are varied in order to keep losses as small as possible. In 
this form of operation, the set points of valves, pumps and the power supplied to heat 
exchangers within the producers is varied in a coordinated form. 


Note, that within the CFVT and the VFCT operation modes the constant values, mass flows or 
temperatures, can be varied step wise, e.g. dependent on the ambient temperature T®. Also, 
many DHNs are operated based on a combination of weather forecast, historical measurement 
data, as well as expert knowledge and experience of operation staff. However, it is well known 
that using the full system flexibility by the VFVT operation mode brings the highest efficiency 
[DLS*19, ZZZW18a]°°. Therefore, this form of network operation is envisioned, for the de- 
signed model, in this thesis. As the CFVT and the VFCT operation modes are a special case of 
the VFVT network operation, a model designed for this form of operation can also be applied 
in case a DHN is operated with CFVT or VFCT conditions. Therefore, this selection of opera- 
tion form for the DHN model does not represent a limitation but instead enables to represent 
all major forms of network operation. 


The characteristics of the most important elements in DHNs are described in the following. 
These are nodes, loops, control paths, pumps, DPRs, valves, heat exchangers, pipelines, and 
TESSs. Therefore, hydraulic and the thermal models of the network components are given. 
The hydraulic model defines the mass flows and differential pressures throughout the DHN. 
The thermal model describes the temperature changes in the different network components 
and the propagation of temperature fronts throughout the network. Before the hydraulic and 
the thermal models are presented, the most relevant material properties of water are given 
below. 


2.3.1 Material Properties of Water 


The density p”, the specific heat capacity c” and the kinematic viscosity% v of liquid water 
are dependent on temperature and pressure levels. In Figure 2.5, the degree of these variations 
is depicted for possible ranges of pressure and temperature values in DHN operation. There- 
from, it can be seen that the density reaches values of 939.16 kg/m? < po“ < 998.35kg/m?. 
Thus, modeling water as incompressible, utilizing a value of p¥ = 960 kg/m?, leads to a re- 
sulting maximal possible deviation of 3.99 %. Similarly, the specific heat capacity ranges from 
4.173kJ/(kgK) < c” < 4.255kJ/(kg K). With a constant value of c” = 4.214kJ/(kg K) 
the largest occurring error is 0.97 %. Hence, the resulting errors, brought into the model by 
constant values of p” and c”, are assumed to be negligibly small as they are below 4%. 


More detailed examination is needed for the kinematic viscosity as value ranges are within 
0.2366 x 107 m?/s < v < 1.8 x 1078 m?/s. Consequently, a kinematic viscosity of v = 
0.8369 x 10~° m? /s leads to a possible deviation of 115.08 %. To understand the impact of this 
deviation on the pressure difference over a pipeline a parameter study was performed, which 


33 In this context, it should also be noted, that within the aforementioned forms of operation, different forms of 


pump operation can be found. A good overview on these is provided in [NTJK20]. 
Note, that there is a difference between the dynamic viscosity and the kinematic viscosity which are both utilized 
throughout the literature, typically as constant values e.g. in [Tr699]. 
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Figure 2.5: Values of the density p“, the specific heat capacity c™ and the kinematic viscosity v of liquid water for 
different temperatures and absolute pressure levels from [Els18, VDI13]. These are possible operation 
values of DHNs, see e.g. [ZWW+21, NTJK20]. The values of the kinematic viscosity change strongly 
for temperatures > 100°C combined with low pressure values of 1 bar [VDI13]. These conditions are 
avoided in DHN operation, by setting the minimal absolute pressure p™'” accordingly > 1 bar, to prevent 
evaporation [NTJK20] and are thus not plotted here for the kinematic viscosity. Exemplary values of e.g. 
pin = 3 bar are given in [NTJK20, p. 57]. 
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is shown in Figure 2.6. Therein, the pressure difference over a pipeline is given for possible 
flow velocities v and the minimal, maximal and utilized value of the kinematic viscosity v. The 
maximal possible deviation between these differential pressures calculated with the minimal 
or maximal and the utilized value of v is shown in red. Similarly, as with the approximation of 
the friction factor calculation in Section 2.3.2, the possible deviation reaches values of 35.85 % 
for less likely low flow velocities and drops below 15% for typical flows of v > 1.4m/s. 
For the proposed rolling horizon approach, see Remark 2.1, the obtained accuracy is seen as 
sufficient and thus this aspect is disregarded. However, if more accuracy is needed it is possible 
to integrate look-up tables into the implementation which adapt the values of ve, for every 
pipeline and time step before the optimization. 


-104 
1.27 0.5 
— Ap for v = 0.2366 x 107° m? /s 
Pe Ap for v = 0.8369 x 1076 m?/s sat 
=== Ap for v = 1.8 x 10 ®m?/s 4 “10.4 
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Figure 2.6: Influence of varying kinematic viscosity v on the resulting differential pressure over a pipeline, based on 
the parameters for a pipeline taken from the hydraulic pipeline calculations in Section 2.3.2. 


Summarizing the aforementioned leads to: 


Assumption 2.1. The resulting errors, brought into the model by constant values of the density 
p“, the specific heat capacity c”, and the kinematic viscosity v of water are negligibly small. 


Besides the aforementioned, a typical assumption usually used within operational optimiza- 
tion models, and also within most DHN simulation models is: [OUGP16, DAM19]: 


Assumption 2.2. The cross-section of a component, e.g. a pipeline, has spatially homogeneous 
velocity and temperature throughout. 


Using this assumptions leads to much simpler 1D component models. 
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2.3.2 Hydraulic model 


The models of all typical hydraulic elements are given below. For all components representing 
DHN edges e, a general stationary relation of the mass flow m and the pressure difference can 


be defined as [T1120]: 
Ape. k = Bek + He, ke, k|Me,k| Aes Vee seh ke Sk, (2.19) 


where ß and p are the variable component coefficients, which are given in detail for each 
component below. This equation is continuously differentiable as the absolute value function 
of the mass flow m is replaced by a continuous differentiable approximation given by: 


[Mhe klae = 4/ Ae + (Me,x)? (2.20) 


wherein Ae > 0 is a sufficiently small parameter. 


In case of predefined positive flow direction”, thus when the e is not element of the set of all 
edges with VMFDs S¥™4, (2.19) can be written as: 


Apek = Ber + He k(Me k), Vee Sted Syed Kes, (2.21) 
The pressure difference Ap over the edges is defined as: 


Apek =- ), Amin, Vee Si, keS, (2.22) 


i,e 
iesihn 


where p; describes the absolute nodal pressure values®*. 


Node The law of conservation of mass is represented by (2.23)? to model the equality of 
mass flows entering and leaving a node i: 


XO A mee = 0, Vics”, k eS; (2.23) 


ecsgbn 


Therein, the mass flow through edge e at time step k is defined as rm.,, and the DHN node 


edge incidence matrix elements Aghn are defined as in (2.1). 


Loop The second important conservation law used to model the elementary hydraulic pro- 
cesses is the conservation of energy. This states, that the pressure differences Ap,,, along a 
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Flow direction equals the edge orientation. 

A pressure maintenance unit guarantees a constant base pressure po at a distinct node of the DHN This is typically 
a node in the return network near larger DHN pumps [NTJK18]. Based on this, the pressure differences created 
through water loss and density variations of the medium caused by temperature variations are balanced. 

When only the supply network is modeled for simplicity reasons, the right hand side of (2.23) is extended by nodal 
mass flows, describing the mass flows fed into the supply network by e.g. producers or storages [MGRt 21]. 
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loop l must add up to zero: 


NO BieApek =0, YLES, k ES, (2.24) 


ecSgbn 


where the set of all loops of the DHN is S{"" and the loop edge incidence matrix elements are 
given as: 


1, if e is directed as |, 
Bi e = 4 —1, if e is directed in opposition to l, » VIE sdn e g gdn (2.25) 


0, if e is not element of J, 


ControlPath Besides the loops, control paths are also not component models, as they model 
the interaction of multiple components. Control paths consider the influence of controlled 
pumps and valves on the respective network edges, from the controlled element to the element 
where the controlled variable is measured. Typically the controlled variable is the predefined 
differential pressure ApP™° over a pump, a set of edges, a valve or a consumer substation. The 
control path is then modeled, by defining, that the pressure drop over all edges of the control 
path should equal Ap™"°: 


5 Rep,eAPe,k = Apr’, y cp € gdr k € Sk (2.26) 


cp 2 
eesdhn 


Therein, the control path edge incidence matrix elements Rep, e are given as: 


1, if e is directed as cp, 


Repe = \ —1, if e is directed in opposition to c, p | V cp € sgn, e c Sin (2.27) 


0, if e is not element of cp, 


Pump The pumps are utilized in DHNs to create the necessary differential pressure to circu- 
late the water throughout the other components of the networks. These are typically powered 
by electricity and local pump controllers, which adjust the motor rotation speed in order to 
achieve the desired differential pressure. Within the model this is represented by [OUGP16]: 


Ape,k = Be,k, Vee seme, k ESk (2.28) 


where SP""P describes all edges holding pumps and £ can either be a fixed parameter in the 
case of a predefined pressure difference over the pump” or a variable which is obtained from 
the solution process of the optimization presented in Chapter 3. Note, that within this model 
form further forms of pump operation can be represented. Using control paths, described in 
the previous paragraph, a certain differential pressure over several sequential edges of the 


38 Defined by the control room of the DHN, as often performed today. 
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network can be achieved. Also, the pressure p at a certain node i of the network*? or the 
amount of mass flow m thought the pump [Opp15, NTJK20] can be controlled, by adding 
additional constraints to the optimization problem, as p; p = p; or m... = MPT Vk € Sp. 
Where p?"* and rmP"® represent the predefined set values of the absolute pressure and the mass 
flow in either of these cases. 


Differential Pressure Regulator DPRs help to improve the efficiency of DHN operation. 
These components represent valves, which are opened and closed in order to keep the pressure 
drop over a control path, e.g. a consumer sub station, constant. This provides two important 
functionalities. First, large pressure changes can affect the operational functionality of simple 
valve controls which can cause unwanted pressure oscillations. The later can cause material 
fatigue and inefficient valve operation [Opp15, p. 47]. Second, the utilization of DPRs helps 
to implement an efficient hydraulic balance within the DHN [NTJK20, pp. 146-147]. This 
accomplishes that the mass flows through consumers farther away from the producers are 
streamed through with a similar power as the consumers which are very close to the producers. 
The model is given as: 


Ape,k = Be,k; Vee Si k ESk (2.29) 


the value of the variable 8 is obtained from the solution of the optimization problem presented 
in Chapter 3 and SÄP" describes the set of all edges with DPRs. 


Valve Together with pumps and DPRs, valves are the central active components defining 
the hydraulic effects with in a DHN. The pressure difference over this component type is 
dependent on the mass flow through the valve and can be modeled as [OUGP16]: 


Ape,k = He,kie,k|Me,klAcs Vecs, KES, (2.30) 
Apo(ctemP)? i 

k= ee VeeS!W, ke Sy (2.31) 
Bek Ke) POP : 


where the pressure coefficient u is dependent on the valve flow factor K, its pressure reference 
Apo, the density of water p”, the density reference pọ, and the temporal conversion factor 
ct mp — 3600sh-!. Further, the set of all valves, is stated as a subset of all edges as Su. 
Note, that the operational limits of K refer to open and closed valve state, see Section 3.3.1. 


Heat Exchanger of Consumer or Producer The pressure difference over heat exchangers 
of consumers and producers can be modeled as: 


Apek = He,kMe,k|Me x| ac, Veesah kes, (2.32) 


He,k = SICH Vee Sexch, k eS; (2.33) 


3° E.g. the point with lowest differential pressure between supply and return network, which often describes the 


consumer with the largest distance to heat production. 
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as given in [Köc00] for all e which are in the set of edges containing heat exchangers S°**". The 
friction factor é and the diameter de, and thereby u, are determined by parameter identification 
procedures. Note, that this comprises models, as implemented in [OUGP16, Opp15], where 
u = Dis used. 


Pipeline For all edges e representing pipelines SPiP® the model is defined as: 


Ape,k T: Bek + He,kMe,k|Me,k|Ac, Vee Spires ke Sk (2.34) 

Bek = p” gS Ah, Vee Spire k ESk (2.35) 
8 Le | ipe 

Mek = a (g, er 4 de), VeeSpire kE Sy (2.36) 


Therein, the differential pressure is dependent on the height difference Ah between both nodes 
at the beginning and end of the respective pipeline and the gravitational acceleration g°°° 
[Köc00, Tr699]. The pressure coefficient u is dependent on the diameter d and the length L 
of the pipeline, the density of the water p” and the friction factor €. Also further pressure 
loss coefficients, e.g. resulting from curvature are accumulated in w. The Darcy friction factor 
€ itself is highly dependent on the flow conditions, defined by the Reynolds number Re. For 
laminar flows, which are found beneath the critical Reynolds numbers of Reit = 2300 for 
water, the Darcy friction factor can be calculated by [VDI13]: 


VeesPpire k ESk (2.37) 


for larger Reynolds numbers, Re > Ret, which describe the transition zone towards turbu- 


lent flow and turbulent flow conditions”, the Prandtl-Colebrook equation is utilized to deter- 
mine the Darcy friction factor as [Ick95]: 


1 2.51 Te : 
= -2lo + ; Vee Sree k ESk 2.38 
V bok eae (a Eek via) € 
re \ Y 69 
x —1.81 £ p Vee Spire kes 2.39 
0810 (=) maa ec e ’ ESE ( ) 
r 5.74 : 
= —-21 © Pipe k 2.40 
0810 (Si) a Vee Se ’ € Sk ( ) 


Two approximations of (2.38) are given above. The first is the Haaland and the second the 
Swamee approximation, which both enable to replace the implicit Prandtl-Colebrook equation 
by an explicit alternative [Brk11]. The roughness values of the pipeline wall r is typically 
around r ~ 0.01 mm in DHN pipelines [NTJK18, p. 118]. 


40 The transition zone between laminar and turbulent flow is defined around 2300 < Re < 5000, see [Opp15, p. 


33] for more details, as well as [VDI13, p. 1225] and [NTJK20, p. 118]. 
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The Reynolds number itself is defined as [VDI13]: 


Een 
Reeg = - k Veespire kE Sp (2.41) 


Ay de|Ve,k|Ac 
V 


; Veespire k ESk (2.42) 


In order to calculate the Reynolds number of a pipeline correctly, independent of the flow 
direction, the absolute value approximation is used in equation (2.42) as in equation (2.20) and 
[Trö99]. It is dependent on the flow velocity v and the kinematic viscosity of water v. In 
normal DHN operation the absolute values of the flow velocities v in the pipelines range from 
0.8 m/s to 3m/s [Glüs5b, p. 29], however to also cover less likely lower flows a lower limit 
of 1 x 107? m/s is regarded here. The kinematic viscosity of water can range from 0.2366 x 
107 m?/s < v < 1.8x 10° m?/s for typical pressure and temperature ranges of DHN states, 
see material properties of water in Section 2.3.1. Thus, possible Reynolds numbers"! are within 
2.722 x 10? < Re < 6.3339 x 10°. This leads to: 


Assumption 2.3. The Prandtl-Colebrook equation, stated in equation (2.38), can be adequately 
represented by the Haaland or the Swamee approximation, given in (2.39) and (2.40), for all pos- 
sible Reynolds numbers. 


This is due to the fact, that for Re > Re“ the deviation between (2.38) and (2.39) or (2.40) is 
small, and the larger deviation for lower Reynolds numbers has a minor effect, as the overall 
pressure drop becomes negligible in this case, compared to other pipelines with higher flow 
rates [Tr699]. To underline these facts, the following example quantifies the impact of the 
utilized approximation. The calculations are performed for a pipeline with a diameter of d = 
0.5m, a length of L = 100m, and a roughness value of r = 0.01 mm. Further a constant 
density of water of p” = 960 kg/m? is used, due to the small relative changes of the water 
density for DHN operation conditions, see Assumption 2.1 in Section 2.3.1. The resulting 
pipeline friction factors € are shown in Figure 2.7. Note, that the values of the friction factor 
resulting from the Haaland and the Swamee approximation only show very small deviations 
below 1.4%. Therefore these approximations are hard to distinguish before Figure 2.10. 


Based on the friction factors €, the pressure coefficients u can be determined, which are shown 
in Figure 2.8. This graph shows the desired reference as the Laminar and Prandtl-Colebrook 
case, which is based on a calculation of € with (2.37) for Re < Re“ and (2.38) for Re > Re“, 
The differential pressure over the entire pipeline calculated by (2.34) for different flow veloc- 
ities is shown in Figure 2.9. Therefore, the differential pressure is once calculated with the 
desired reference values of p, given as the laminar and Prandtl-Colebrook case in Figure 2.8 
and once with the values of u calculated with the Haaland approximation in (2.39). For in- 
creasing flow velocities, the lowest possible Reynolds numbers increase as well, see (2.41). 
These limits Re™™ are now defined by the maximal value of the kinematic viscosity of wa- 
ter v™* = 1.8 x 107 m?/s. To depict the limits of the possible differential pressures and 
the deviations of the later, for the different flow velocities, the aforementioned Re™™ limits 
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Given minimal flow velocities of v = 1 x 1073 m/s. 
Plotted in green color. 
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Figure 2.7: Darcy friction factor for possibly occurring Reynolds numbers in DHN operation conditions, including 


laminar and turbulent flows. 
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Figure 2.8: Values of the pipeline pressure coefficient p for possibly occurring Reynolds numbers in DHN operation 


conditions resulting from the different Darcy friction factor calculation forms. 


38 2 Modeling of Coupled Electric Power and District Heating Networks 


105 + : : — Aprefwı 
i i —= Aprehv2 
i i ae — Aprefvs 
; ; il = ref ua 

10? 3 ek Apt 
i pi Saa Aphaavı 
È F : : a) - *- Aphaav 
8 10! E : : : : sga Apbaavs 
4 H : Ü | |: -xo Apea 
= i ? BOH o pee Ret!mvi 
107+ | : ; ; sang Reminv 
lel | | TTT | sesso Re™ U3 
wie Rem va 

10° I N ee TI] (er Rett 

fi Pall en į i iil Ll DEN i i terre 
10? 10° 104 10° 10° 107 


Figure 2.9: Differential pressure Ap for different flow velocities vı = 1 x 1073 m/s, va = 1m/s, v3 = 2m/s 
and va = 3m/s for possibly occurring Reynolds numbers in DHN operation conditions, obtained from 
different calculations of the friction factor. Note, that due to the small differences between the Haaland 
and the Swamee approximation, only the prior is shown here. However both are further compared in the 
following analysis. 


are shown as well in Figure 2.9 and 2.10. The resulting absolute deviation Ap*°Y between 
the pressure drop resulting from the exact calculation from the pressure drop reference Ap"! 
with the stated approximations Ap??? or Ap’Wame® is given in Figure 2.10. The relative error 
arising from the used approximations on the calculated differential pressure over the pipeline 
is given in Table 2.2 and 2.3. The quantitative study shows, that the hydraulic pipeline model 
using either the Swamee or the Haaland approximation for all flow conditions is very accu- 
rate, with errors below 1.3%, for flow velocities v > 1m/s. Further, for flow velocities of 
vot = 8.28 x 1073 m/s the critical Reynolds number is definitely reached. Therefore, it can 
be understood, that in DHNs the non laminar flow conditions represent the prevailing case. 
Much more, based on typical flow velocities turbulent flow can be assumed in DHN pipelines 
[NTJK20, p. 117]. For Re > Re“ the relative error instantly decreases to the lower single- 
digit percent range. Thus, the used approximations lead to very exact results in the prevailing 
cases. In the case of very low flow velocities v < v‘"* the resulting pressure drop over the 
pipeline becomes negligibly small, as it is a factor 10° smaller than the largest possible pres- 
sure drop. Therefore, the errors brought to the rest of the model, e.g. pressure drops of other 
pipelines, are then also neglectable. 
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Figure 2.10: Pressure difference deviation occurring from different calculations of the friction factor for differing 
velocities for possibly occurring Reynolds numbers in DHN operation conditions 


10° 


Table 2.2: Set of relevant values for estimation of occurring error through the used Swamee approximation for the 


Darcy friction factor calculation. 


Flow Maximal absolute deviation Pressure drop at Relative 

velocity in pressure drop maximal deviation | error 

v Apdev = |Aptet _ A Apt Apdev / Apr 

1x 10-3 m/s 0.0101 Pa 0.0213 Pa 47.42% 
1m/s 6.583 Pa 1431 Pa 0.46 % 
2m/s 11.8 Pa 5079 Pa 0.23 % 
3m/s 54.93 Pa 8552 Pa 0.64% 


Storage The storage model is highly dependable on the type of the storage and its form 
of operation. We restrict ourselves to unpressurized sensible“ hot water storages [NTJK20], 


which are directly connected to the grid, as sensible hot water storages are the most used 


form in practice, due to the low costs and the high level of technological maturity [NTJK18] 


[CMT* 17, p. 73f]. Hereby, there is no hydraulic separation between the grid and the storage. 


# “In sensible heat storage, a storage medium is heated or cooled without phase change.” [NTJK20, p. 37] 
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Table 2.3: Set of relevant values for estimation of occurring error through the used Haaland approximation for the 
Darcy friction factor calculation. 


Flow Maximal absolute deviation | Pressure drop at Relative 

velocity in pressure drop maximal deviation | error 

v Apdev = | Aptef = Lape? | Apr Apdev / Aptet 

1 x 10° m/s 0.0101 Pa 0.0213 Pa 47.42 % 
1m/s 15.86 Pa 1431 Pa 1.11% 
2m/s 53.89 Pa 5079 Pa 1.06 % 
3m/s 108.7 Pa 8552 Pa 1.27 % 


Therefore, the hydraulics of the storage can be modeled similarly as a pipeline with a large 
diameter. 


Ape,k = Ber + he ke, k|Me,kl|Ae, Veces, k ESk (2.43) 
Be,k = p7 gAh, Vee St, k ESk (2.44) 


The values of the pressure coefficient u depend on the special design form e.g. if plates are used 
to help preserve the stratification. The coefficient is determined by a parameter identification 
procedure, with u > 0. Further, Ape, can become > 0 and < 0 based on the two possible 
cases, charging and discharging. The set of all edges containing thermal storage devices is 
given by S$t°", 


2.3.3 Thermal model 


The thermal model describes the temperature changes occurring in the different network com- 
ponents and the storage dynamics of pipelines and Thermal Energy Storage Systems (TESS). 


Node In network graphs in general and for DHNs specifically, nodes are the components 
connecting multiple edges at a certain location. The thermal node models determine the node 
temperatures, which are important as they define the temperatures of the water entering the 
connected edges with water inflow. These node temperatures are calculated by using the 
following simplification: 


Assumption 2.4. Water flowing into a DHN node i from multiple edges e undergoes perfect 
instant intermixture and therefore the out flowing water has a homogeneous temperature T. 


Note, that this assumption is used in the prevailing amount of literature in the field of optimal 
DHN operation, see e.g. [DLS* 19, LWS*15, CWW* 18b, Tr699] and also in many simulation 
models [LWJB16, OUGP16, Ick95]. The thermal balance equation is given below for two cases. 
The first is the simpler case, where only edges with predefined flow directions are connected 
to the node. The set of nodes 7 for which this condition holds is given as the set of all nodes 
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excluding the nodes where edges with possibly VMFDs are connected, thus Sdhn A i ¢ symfd, 
This very common equation in DHN modeling can be found e.g. in [LWS* 15]: 


dhn,— . dhn,+ - out - dhn - vmfd 
X i Aie Te,kTi,k = > (Aie Mek Tek }; vie S; Ni ¢ S; ‚k € Sk 
eeSdhn eeSdhn 


(2.45) 


The node temperature T; and the outlet temperatures T°”! of the edges with water flowing 
into the node are found in the above equation, as well as the elements of the incoming and 
leaving edge node incidence matrices A“"’* and A™™- of the DHN. These elements are 


defined as: 


Lif Alte — +1, 


dhn,+ _ f } dh dh 
An Vi esp eeso 
, else, 
1, if Aĵ" = -1 
a k i ne Vi e SP”, e e som (2.46) 
, else, 


The second case is defined for all nodes where at least on one connected edge a flow direction 
change can take place. These nodes i are consolidated in S¥™*. In this case the heat balance 
equation considers all possible flow conditions, as given in [Tr699]: 


5 Ae max (me,k, 0) + 5 apart max (-Me,x,0) | Tik 


’ 


eeSdhn eeSdhn 
= So (At max(me r, OTSR) + XO (AR max(—Me, k, OTH), (2.47) 
ecsghn eeSdhn 


Vie St™ are sm nes, 


The right-hand side of equation (2.47) contains the sum of all temperatures entering this node, 
weighted by their mass flows m. This has to equal the node temperature T;, which is multi- 
plied by the mass flows leaving the node. All possible cases, based on the varying mass flow 
directions in the pipelines, are distinguished by combining the incoming and leaving node 
edge incidence matrix elements Aver and A and the approximated maximum oper- 
ator. The approximation is analogous to the absolute value function approximation in (2.20) 


and defined as: 
4 [Tne y +Ac+ Me,k 


2 


max(mMe,r,0) © (2.48) 


Input temperature of all components except nodes, storages and pipes Assuming the 
utilization of check valves“* in all components except nodes, all components in storages sys- 
tems*, and pipes, the flow direction can be modeled as unidirectional through these edges. 


44 
45 


Valves, often utilized in water networks, which can only be streamed through in one direction. 
These include a valve, a pump and the heat exchanger of a storage system. 
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Thus, the input temperature of the respective components can be defined by: 


in __ dhn,— 
e,k 7 ; Aie Ti k, 


icsghn 


Ve E SI A e g SPP A e g S37 A e ES" A e g SRUmPStor, k € Sp (2.49) 


where the set of all storage valves and pumps are given by S¥!V-stor and Spump,stor, 


Pump The mechanical degree of efficiency of pumps 7?"P describes the rate of coupling 
power to the delivery rate. Assuming all losses will heat up water, it can be used to describe 
the temperature change over a pump, as follows®° [Opp15]: 


out = Tin = |A 1- cn 
e,k ek = | Perl 


——___, Vee spump k € Sk (2.50) 
pump gw.cw 

The following example will show that it is possible to neglect the temperature gain over a 
pump in a DHN due to the small resulting error. For a given DHN pump [DHN] with a minimal 
mechanical efficiency 7?"™P of 30 %, a maximal differential pressure Ap of 16 bar, a minimal 
specific heat capacity of 4.182 kJ/(kg K), and a minimal density of water p” of 939.2 kg/m? 
the resulting temperature gain over the pump is given in Figure 2.11. Therefrom, it can be seen 
that the maximal temperature change is below 1 K and can thus be neglected for simplicity 
reasons. Based on the above, the temperature gain over a pump can be neglected, and equation 
(2.50) can be simplified to [Tr699]: 

Spare = ce Vee SPIP A e ¢ Spumpstor k € Sy (2.51) 
Pumps installed to fill or unload storage systems can be operated in both flow directions. 
Consequently, the in- or outlet temperature of the edge is defined by: 


a : 
Kekiskler T Neen Tek 
dhn,— dhn,+ 
T 5 (ane Xe,k,ot + Ave. kr) Ti,k, 
icsghn 
VeeSpwmpstor k € Sk (2.52) 
The variables Xe k,o+ and Xe ko- are used to approximate the utilization of boolean integer 


variables, becoming 0 or 1 for positive or negative flow on the respective edge. These vari- 
ables are calculated by using a continuous differentiable approximation of the Heaviside step 


46 For that matter, the flow direction is assumed to align with the edge orientation. 
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Figure 2.11: Temperature gain over DHN pump for different mechanical efficiency factors and differential pressures. 


function and its at the axis of the ordinate reflected counterpart, defined as follows: 


_ af (Mek + Ae)? + Ae? — y (Te p — AE)? + Ae? + 2Ae 
Xe,k,ot+ = ANE 


1 for mer > 0, a 
z% _ Vee Si", k ESk (2.53) 
0 for mer < 0, 
Xe,k,ot = 1- Xe,k,o-» Vee a, k E€ Sk (2.54) 


Valve The temperature gain?‘ over valves, can be calculated by [Ick95]: 


in _ |Ape,r| 


Tel = no Vecs, k ESk (2.55) 


For a theoretically maximal possible pressure difference of 25bar occurring in 
DHNs [ZWW+21], the temperature change would be below 0.64 K”. Thus, the ther- 
mal models of valves can be simplified to [Trö99]: 


TER = TË Ve ESY Ae g Sy", k € Sy (2.56) 


47 The calculation is based on the same values for pW and c” as in Subsection 2.3.3. 
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For valves used in storage systems, the input or output temperature is defined as follows, in 
order to represent both flow directions in the model: 


out in 
Xe,kot Lek + Xe,k,o- e,k 


=> ee + Auer De Yee Syst Kes, (257) 


wesädhn 


Differential Pressure Regulator DPRs are special valves which are controlled to keep the 
pressure difference over a control path constant. Still, their buildup does not deviate from 
other valves. Thus, they can be modeled as regular valves [Opp15], see equation (2.56): 


Inn, Vee Sit k ESk (2.58) 


Consumer and Producer The heat power supply or demand ® of producers, energy con- 
verters, and consumers is defined by the following equation, throughout the existing literature, 
as e.g. given in [LWJB16]: 


Dnn=c") MEM ne (TO — TH), Yn CESK An ESH KES, (259) 
e€S? 


Note, that opposed to the State of the Art (SOTA) we have included an edge NP matrix element 
M, ap as defined in equation (2.3), into the equation (2.59) above. Thereby, the needed sum 
over the set of all edges which have NPs connected S?, is used, to enable a clear mapping of 


an NP to the respective edge in the DHN . 


Storage As discussed in Subsection 2.3.2 sensible hot water storages are regarded in this 
work. These TESS typically store large amounts of water, in order to store heat for days (short 
term TESS) up to seasons (long-term TESS) [GV19]. Short term storages for cities usually 
have capacities of around 15 000m? [GV19] up to 30000 m? [Kie16]. Further, they contain 
baffle plates which enhance the stratification process. In these storage systems, a thermocline 
layer separates a layer of hot water at the top of the storage from a layer of cold water at the 
bottom [SDPT16]. Therefore, within the application presented here, it is possible to model 
the temperature entering and leaving the TESS T™ and T°“* by constant temperature values 
2, and TP9t found at the top and bottom of the storage. Concerning > a amounts of 


water within these systems and the stratification, the values TSOP „ and T, Te are assumed to 
remain constant over the simulation/prediction horizon“® and are updated with measurement 
data after every time step. Following the aforementioned, for discharging and charging the 


48 As the presented model can be applied for simulation or optimization of CEPDHNs, simulation and prediction 


horizon are used both here, referring to the same set of time steps Sx. 
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temperature of the water leaving the storage is defined by: 


DDr AT, Ve ES? k eS, (2.60) 
nesdha,stor 

= I. MER Vee St" k eS, (2.61) 
gdhn,stor 


The heat input or output is defined as in [NTJK18]. Note, that this equation is formulated for 
charging and discharging here, with the respective efficiency factors for the charging nt" 
and the discharging ı°*"-dChr process, as given in [VSG* 17]: 


w dhn stor,dchr out ptor ‚chr in 
Pn, k =C > Me. n me; klae (x Xe,k,o+Te, k tn Xe,k,o- =) 


eeSstor 
stor,dchr ,dhn,— stor,chr au ‚+ 
= ) (r Aie Xe,k,ot + um A; enor ) Tra ; (2.62) 
ieSdhn 


Vn € Si" k ESk 


Note, that the approximated binary variables, y,+ and x,-, calculated during the solution 
process from (2.57), based on the flow direction, define if the TESS is charged or discharged. 
In the later case, the sign of the heat power is positive ® > 0, following the active sign 
convention. Further, when the storage is discharged the mass flow is positive m > 0, this 
implies, that the edge directions of the storage components, defined in the node edge incidence 
matrix A‘, are directed from the return network toward the supply network, see Figure 4.13. 
The stored quantity of heat F, the State of Charge (SOC), is defined over time as in [VSG* 17, 
WYA?t15]”: 


Enke+1 = En,k a Ak®,, k as lnk, Vne Se k < [S4] € Sk (2.63) 
Enya = Ene) Vn e Sister (2.64) 


The storage losses l are calculated as defined in [VSG* 17] by: 
ln SAR Re ee — T’), Vn E SŽ, k < |Sz| € Sk (2.65) 


with the surface of the TESS A*t", the heat transfer coefficient Rt, and the mean tempera- 
ture of the water in the storage is given by Ttormean, 


Pipeline The choice of an adequate pipeline model is of high relevance for operational op- 
timization tasks of CEPDHNs. This is due to the fact, that pipelines are the most common 
components in DHNs and thus imprecise pipeline models can lead to significant subsequent 


49 The charging and discharging efficiencies used within equation (2.63) of this work as in [VSG* 17], are included 


in equation (2.62). 
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errors®. At the same time the amount of optimization variables used for every pipeline should 
be limited in order to keep the amount of optimization variables of the entire CEPDHN op- 
timization problem manageable. Thus, in previous work of the author [MRMH21] the most 
common pipeline models used within CEPDHN models, namely the Node Method (NM), ap- 
proximations of the NM, the Lagrangian approach and different Finite Difference (FD) ap- 
proaches are qualitatively and quantitatively compared for the application within operational 
optimization. The results of the quantitative comparison in [MRMH21] clearly show, that the 
the NM brings along the highest modeling accuracy. 

The downside of the NM in its original form, as presented in [Ben91], is that the pipeline 
model itself is dependent on the solution of integer optimization problems which need to be 
solved at runtime if the model is directly used within operational optimization. This turns the 
NLP problem into a MINLP problem, which scales badly. To circumvent the computational 
burden, in [LWS* 15] an iterative procedure is presented which calculates the solutions of the 
integer optimization problems and uses these in the dispatch problem before repeating both 
calculations sequentially. However, the approach presented in [LWS*15] uses an approxi- 
mation of the length of stay of the water masses within a pipeline and is further limited to 
unidirectional mass flow conditions, which are usually not given in DHNs. A different ap- 
proach using a thermal pipeline model, based on a linear interpolation of node temperatures, 
that can be applied in the case of VMFDs is presented in [Tr699]. Still due to convergence 
issues, the flow direction of every edge is fixed over the entire prediction horizon to one flow 
direction. 

The pipeline model contributed within this work, and presented below, brings together the 
advantages of the aforementioned approaches [Ben91, LWS* 15, Trö99] and augments these 
by two aspects. First, a new and more precise formula for the calculation of the length of stay 
of a water mass within a pipeline is used, which was first presented in the authors previous 
work [MEKH18]. Second, the concept of the flow direction path is introduced to limit the 
possible combinatorial flow direction options within a pipeline over the prediction horizon. 


Besides the Assumptions 2.1 and 2.2, the pipeline model is based on the following simplifica- 
tions [HAH17, DAM19, Opp15]: 


Assumption 2.5. Frictional heat is negligible, the pipeline is cylindrical, has a constant heat 
transmission coefficient, and the ambient temperature is constant along the length of the pipeline. 


Assumption 2.6. Heat diffusion in the axial direction can be neglected. 


Note, that the comparison of simulated results of the author based on the NM with the 
measurement data from [HFT*17] showed very small Root-Mean-Square Errors (RMSEs) of 
0.507 °C for multiple scenarios [MRMH21]. Therefore, the assumptions above are appropriate 
for operational optimization. Further, within the model below the following simplification is 
used: 


Assumption 2.7. Pipelines do not possess a steel core. 


50 The trivial worst case includes multiple serial pipes all modeled with a thermal model providing a too high/low 


output temperature. 
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This simplification is no limitation to the used methodology, as the model presented below 
could be extended to steel cores, by using equation (6) and (7) from [MRMH21], for both 
flow directions. Nevertheless, future fourth and fifth generation DHNs will be operated at 
lower temperatures [LSG* 17], and thus steel cores will no more be used within the respective 
pipelines. 


The model, presented first within this work, tracks the water masses defined by a respective 
quadruple (e, k,¢, o). These indices defining a certain water mass in a pipeline e, at time 
step k, at position ¢, and for the flow direction o. The position ¢ represents an integer value 
numbering the different water masses in ascending order from the entering end of the pipeline 
to the outgoing end. Note, that the entering and outgoing end are in this case dependent on 
the flow direction. As all parameters are given for positive and negative flow direction, the 
entire model is set up twice, once for every flow direction. The size of the water masses is 
defined by the mass flow m flowing into the pipe at the respective time step. The temperature 
of the water masses is set equal to the corresponding temperature of the node T;, through 
which the water mass entered the pipeline. The main variables and parameters, which will be 
fully described in the following, are depicted in Figure 2.12. Here, for simplicity reasons in this 
Figure 2.12 it is assumed that only the positive flow direction o* case is possible for all time 
steps. The mass flow values defining the length of the water masses”! shown in Figure 2.12 are 
predicted mass flows rn. These are obtained from the last optimization of the rolling horizon 
approach, see Remark 2.1. Using these predicted mass flows prevents having to solve the 
integer optimization problems, stated in Section 2.3.3, during runtime of the optimization, 
presented in Chapter 3. 
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Figure 2.12: Scheme of a pipeline and relevant variables and parameters in the node method. For simplicity only 
the positive flow direction case a+ is shown here. The pipeline cross section and length are stated by 
ASS and L. The positions ¢, and Çe define the temporally seen last and first water masses leaving 
the pipeline. The water masses RW” and SW" describe aggregated water masses of all water elements 
on the positions from the beginning of the pipeline up to the one determined by y and e — 1. Note, that 
the calculation of these parameters is provided in Section 2.3.3. 


51 Resulting from the flow velocity during the respective time steps. 
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The assignment of a node temperature T; to the respective water mass temperature Te k,¢,o is 
provided by the following equation: 


= dhn,sgn 7 $ p p 
Te,k,¢,o = > 5 A; ed Ona alik t 5 Ze) ’ 


oESo icsdhn EESk kPESkp 


Vee SPP: k E Sp, C € Sc,0 € Se 
(2.66) 


in which the set of all positions ¢ and flow directions ø are stated as Sc and S,. The node tem- 
peratures within the current prediction horizon T; , and the past time steps TP,» are used”. 
Further the correct mapping of the respective (past) node temperature to the distinct water 
mass is accomplished by three sums iterating over all flow directions ø, all nodes 7 and all 
(past) time steps (kP/)k, and two matrices. The first is the flow direction dependent incom- 
ing/leaving node edge incidence matrix A9™™S8®, This is used to select the appropriate nodes 
from which the water mass has entered the pipeline which is assigned by the flow direction 
and the regarded edge, and is defined as given below: 

1, ifõ= land Ale =1 


k 


A = or if ¢ = 2 and An zi 
0, else, 
Vi € Sie € SEP., ë € So (2.67) 


The second matrix utilized in equation (2.66) is the six dimensional entering time step matrix 
Z, which is defined as ZP for past time steps kP. For a given quadruple (e, k, Ç, o) defining a 
certain water mass”, the entering time step matrix Z/past time step matrix Z? provides the 
information at which time step k/past time step kP this water mass has entered the pipeline 
and with which flow direction o. The single matrix elements are given as: 


1, ifin pipeline e, at time step k, the water mass at position ¢ 


of flow direction o has entered the pipeline at 


Z an = 
ae time step k with flow direction ©, 
0, else, 
VeecSpire k kESk, CES¢, o, ES- (2.68) 
1, if in pipeline e, at time step k, the water mass at position ¢ 
ZP = of flow direction o has entered the pipeline at the past 
€k,C,0,kP a 


time step kP with the flow direction o, 


0, else, 


Vee Shire, kESk, CES¢, kP ESk, 0,6 ES, (2.69) 
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Note that k and k, as well as o and ø are defined for the same set Sẹ and So respectively. 
Within the model, in a pipeline e, at time step k, at position Ç, and for the flow direction ø. 
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For a more intuitive understanding, exemplary values for entries in the matrices Z and ZP 
are provided in Example 2.1 in (2.86) and (2.87). 


The lossless outlet temperature of a pipeline is calculated based on a weighted sum of the tem- 
peratures ofthe water masses leaving the pipeline in the current time step, see also Figure 2.12, 
as given in [Ben91]*: 


e—1l 
Tore Woryelekyet I, Ueno Tarte + We,k,e,oTe,k,e,0 
c=y+l 
€ 
= >» We,k,C,oLe,k,C,o> Vee Spe, k € Sk, 0 E€ So (2.70) 
=y 


Note, that for both flow directions an output temperature is provided, as the index o can stand 
for positive or negative flow direction ot or 0”, also see Figure 2.13. The exact calculation 
of the weights w € [0, 1] used in the above equation (2.70) are given later in equations (2.100) 
to (2.102). The temperature drop occurring to water masses leaving the pipeline is calculated 
by equation (2.71). Heat losses rise with increasing length of stay t and difference between 
the lossless outlet temperature T°“! and the ambient temperature T®. Thus, the lossy outlet 
temperature T°? is given by [Ben91]: 


te Oo i 
qoute = T? 4 (T91 _ T?) exp (-“#=) , Veespire keES,,0€S, (2.71) 


k sk, 
e,k,o e,k,o Te 


The used loss coefficient T. is dependent on the cross section of the pipeline A“°®® and its 
thermal resistance R*»®™ and is calculated by: Te = pY cY ATS Rtherm, The temperature of 


the water mass leaving the pipeline in case of positive or negative flow direction o™ or o~ is 
then matched with the leaving or entering edge temperature T°“ or T! by: 

Ye ae re Vee SPP? k E Sy (2.72) 

Pe OR Vee SPP: k ESk (2.73) 


Note, that in the thermal node equations (2.45) and (2.47) only T°"* or TÌ” has a relevant 
impact on the temperature T; of one of the nodes connected to the pipeline i. This is due to 
the fact that either max(m,0) or max(—rn, 0) in (2.47) will become nearly zero depending 
on the flow direction or that only T°“ is taken into account in (2.45). The other temperature 
T°"* or T” respectively does not further impact the model. 


After the standard rolling horizon implementation, see Remark 2.1 or Section 3.3, which is used 
for most of the variables in the approach presented, the rolling horizon implementation for the 
following parameters Ze ktoka ZÈ cbs Bee Te,k,C,o> and Ke.x,¢,0 needs special treatment 
in order to adequately represent possible flow direction changes. The values in Ke,k,¢,o repre- 
sent the time steps a water mass has been in the pipeline since entering it, which are important 
values to determine the temperature losses occurring in the pipe. As soon as these parameters 


54 Note that in [Ben91] this equation is not given for both flow directions, also the notation is slightly different as 


the weights w are replaced by their exact definition, which is given later in equations (2.100) to (2.102). 
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are determined, the parameters dependent on Mekco and Ke,k,¢,0 can be recalculated for the 
upcoming time step. These dependent parameters” are needed to calculate the lossless outlet 
temperature of a pipeline T°"! with (2.70) as well as the lossy outlet temperature T°“? in 
(2.71), and will be introduced in Section 2.3.3. Before the special form of rolling horizon pa- 
rameter assignment, which was developed for this model, is presented, the flow direction path 
concept is introduced, as it plays an important role thereby. 


The flow direction path concept As stated above the temperatures and mass flows of the 
water masses in the pipelines are taken into account throughout the model for positive and 
negative flow directions. However, representing all zu possible flow combinations over the 
entire prediction/simulation horizon* 
horizon n°* = |S,|, would result in a large number of parameters and variables, which would 
have to be taken into account. Thus, only the most likely flow conditions are utilized as the 


8 with the cardinality of the time steps on the prediction 


Flow in edge direction o* Flow against edge direction a~ 


| 
al 


t t t H t > yk < t t j j t 
Q Q ¢3 Ga s [© Ga 3 2 Q 
Current flow direction on FDP Current flow direction OFDP 
2 Pipeline wall Water mass 
> -= Flow Direction Path (FDP) FB Specific water mass 


Figure 2.13: The Flow Direction Path (FDP) for a pipeline e depicted as a combination of flow directions o over 
the time steps k of the prediction horizon assuming constant mass flow and thus equally sized water 
masses. The Opposed to Flow Direction Path (OFDP) flow directions are also shown, which are directly 
determined as the opposed flow directions to the FDP, for every time step k. The resulting position ¢ of a 
specific water mass is highlighted to visualize the position changes based on the shown flow directions. 


base case, while the model is also equipped with the ability to factor unexpected flow direction 
changes, e.g. resulting from inaccurate mass flow forecasts m. 


55 wm wm 
Ye,k,o» Ee,k,o; Ro: SER We,k,C,o> and be,k,o: 
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Definition 2.1 


The Flow Direction Path (FDP) represents the predicted combination of positive and 
negative flow directions o for a specific pipeline e for every time step k on the prediction 
horizon. These most likely flow conditions are obtained from the network flows of the 
last optimization. An example of the FDP is provided in Figure 2.13. The mathematical 
definition is given as: 


oP =sgn(mex), Yee SPS, k € Sp (2.74) 


The combination of flow directions o for the respective pipe e over the prediction horizon 
going in the opposite direction are defined as the Opposed to the Flow Direction Path 
(OFDP) case, which is analogously provided by: 


ooh? = —sgn(Te p), Vecs., k € Sp (2.75) 


Note, that the values im. „ in (2.74) and (2.75) represent the initial values of the upcom- 
ing optimization. As the standard rolling horizon time shift is already performed for all 
variables at this point within the overall procedure, as explained in detail in Section 3.3.1. 


Based on Definition 2.1 it can be understood, that the FDP and the case OFDP, as shown in 
Figure 2.13, are determined through the solution of the last optimization/simulation, within 
the rolling horizon procedure. Thus, both FDP and the OFDP case are fixed during every 
optimization, always taking into account the latest predictions of the last optimizations and 
further information as will be explained in detail in Section 3.3.1. During the upcoming so- 
lution process of the next optimization/simulation, the sign of the mass flow sgn(m. .) of 
a certain pipeline e and distinct time step k will affect, if the FDP or the OFDP lossy outlet 
temperature will have a relevant impact on the node bordering the left or right side of the 
pipeline. The two possible cases can be seen in Figure 2.13. Regarding a certain pipe e and kj, 
the first case occurs for sgn(rn. x) = 1 as of = ot the lossy outlet temperature at the right 
end of the pipeline De will impact the node temperature at the right end through (2.72) 
which links Tokar to the thermal node equation (2.45). Analogously, for kı and o°”f® = g7 
the left side outlet temperature TEZ- will impact the node temperature at the left side of 
the pipeline. The lossy outlet temperatures are thereby dependent on the pipeline parameters 
stated in this section and the node temperatures, representing variables during the solution 
process. Changing mass flow values during the solution procedure affect which outlet temper- 
ature of both pipeline ends is used, but not which value this outlet temperature will have. This 
is comprehensible from (2.70), wherein the weights w are parameters, and (2.71). Therefrom 
it can be understood, that as soon as an unforeseen flow direction changes occur, the current 
and all further time steps on the prediction horizon will show deviations. As quality of the 
predictions are assumed to be of high quality in general and increase for time steps closer to 
the current point in time, usual temperature deviations are expected to be within the lower 
single digit range, see Section 2.99. The major advantage of this approach is that it reduces 
the amount of possible flow conditions taken into account from to 2n, which has an 
increasing effect for longer prediction horizons with n° time steps k. Thus, the advantages 
coming from the gain in computation time prevail in the context of the application. 
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As soon as the entire CEPDHN model is solved at a given time step k, the pipeline parame- 
ters are updated to optimally suit the latest mass flow values rn. Thereby, first, all pipeline 
parameters on the FDP are updated for all time steps of the prediction horizon of all pipelines, 
as stated in Case A below. As soon as these values are calculated, the parameters for the flow 
directions OFDP are also updated, see the description of Case B in the subsequent paragraph. 
These OFDP values are of relevance to the model in order to approximate the outlet tempera- 
ture T°“? in the case of an unpredicted mass flow change. 


Case A: Rolling horizon time step shift of the pipeline parameters on the flow 
direction path 


The rolling horizon time step shift is performed in ascending order for k starting with kı. 
There are two main cases that need to be differentiated between within Case A: 


A.1 The flow direction on the flow direction path o'“P within a pipeline e stays the same 
between two consecutive time steps k. Visually speaking, as all water masses are moved 
ahead one position from one time step to the next, this case is referred to as “move ahead” 
in the following. 


A.2 The flow direction on the flow direction path oP within a pipeline e changes between 
two consecutive time steps k. This case will be named “insert and copy previous time 
step” as parameters are assigned by utilizing measurement data or results of the last 
optimization for the values of the first position ¢,°° (insert) and the parameters derived 
for the last time step for all positions ¢ > 1°° (copy previous time step). 


These two cases are illustrated in Figure 2.14 and 2.15. The formulas are given below after two 
further remarks. 


Flow in edge direction o* Flow against edge direction 0” 


— e De 


+k+1 


Figure 2.14: Case A.1: Basic idea of the approach if the flow direction on the flow direction path of4P within a 
pipeline e stays the same between two consecutive time steps k and k + 1, assuming constant mass 
flows. 


56 Of the new time step. 
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As 


Flow in edge direction o Flow against edge direction 0” 


— e < 


t 
Q 2 (3 Ga 65 Co 6 & Ga G Qe Ga 


Figure 2.15: Case A.2: Basic idea of approach if the flow direction on the flow direction path oP within a pipeline 
e changes between two consecutive time steps k and k + 1. 


Note that in the following equations, multiple indices again have sub-indices. Thus, for brevity 
and simplicity, the following notation is defined: 


Definition 2.2 


If not explicitly stated differently, all sub-indices result from the so called "main indices", 
which are the edge e (only pipelines here), time step k, and flow direction o. Exemplary 
the following expression can be simplified as®?: 


a a 


Me k-i fdp = Me,k—1,Cy,ofdp (2.76) 


je o 
‚kor,ofip erk-1 


Note, that the penultimate and last index, kand 6, of the matrices Z and ZP do not possess sub-indices. 
The parameter y in this equation describes the position of the (temporally speaking) last water mass, 
leaving the pipeline, see Figure 2.12. 


b 
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The subsequent differing time step types are defined for clarity reasons in the following as: 


Definition 2.3 


The time step types occurring are: 


1. The time step on the current prediction horizon k. Note, that the time steps k are 
those referred to in all other equations and assignments in this work if not differ- 
ently mentioned. 


. The (past time step/) time step at which the respective water mass entered the 


pipeline (kP/) k. 


. The time steps of the previous optimization, before the currently needed rolling 
horizon time step shift. Thus, for clarity reasons, all parameters referring to val- 
ues previous to the moving horizon time step shift are labeled with Before Rolling 
Horizon (BRH). 


An illustration of these definitions is provided in Figure 2.16. 


Current prediction horizon k € Sk 


Past time steps describing entering time of water mass in pipe kP € Skp 


Time steps on prediction horizon describing entering time of water mass in pipe k € Sx 
Prediction horizon Before Rolling Horizon (BRH) time shift 


> 


Sst time steps 
actual point in time P 


Figure 2.16: Basic example showing the relation of the different time step definitions. 


The rolling horizon definition for the pipeline parameters in Case A.1, also referred to as 
move ahead are assigned as given below. The predicted water masses mh are updated with last 
measurements or latest predictions resulting from the last optimization 7. Note, that only 
the absolute values are necessary here, as the flow direction information is already available 
in o'¢P, For the last time step of the prediction horizon no predicted value is available at this 
point in time, thus this value is assumed to be identical to the mass flow of the next to last 


2.3 District Heating Network 55 


time step k = |S;.|. The exact assignment is given by: 


~ |ne, k| for À = Land k < |S], 
Me, k,C,ofap = x 
[rne k-11] for Ç = 1 and k = |S,|, 
VeeSpire ke, oP ES, (2.77) 


As soon as the values of the first positions (} in the pipeline are updated, the values for the 
rest ofthe positions can be shifted ahead as expected on amoving horizon approach, as always 
with ascending order of k by: 


brh 


u Me dao tofar for k = 1, and Ç < |S¢|, 
Merlot = ) Mex-1,c-1,0fd for k > 1, and ¢ < |S¢|, 
appr ASOS Le for Ç = |Se|, 
Veespire, keSs,, 1<¢<|S<|, of E So (2.78) 


The only exception to this procedure is the safety definition utilized for the last position, in 
order to avoid not fully filled pipelines in the model due to a limited amount of positions in 
the case of low mass flow rates in the past time steps. Such low mass flow rates occurring 
in multiple consecutive time steps are unlikely as DHN operators try to keep the water mass 
circulating in order to prevent accumulation of deposits, as described in last two subsections 
of Section 3.3.1. However, with the following definition, which artificially extends the water 
mass of the last position in the pipe model to the size of the entire pipeline, the model can also 


handle the described scenario”. 


The new entering time step matrix Z is obtained from: 


1, if¢ >1,k>1, and Z,,_ 1,¢-1,0%P,é,¢ = 1, 


Zek, oti ka = orif, = 1, k = k and of® = õ, 
0, else, 
Veespire, kk ESk, CES, oP, ő E So (2.79) 


Therein, the matrix element becomes nonzero if one of the following conditions holds. First, a 
water mass which has entered the pipeline before, during a time step on the prediction horizon, 
is “pushed” one position ahead by the entering water mass. Second, a water mass is entering 
the pipeline at the respective time step k = k, and thus filling the first position ¢ = 1. 


>7 As long as |S¢| + 1 > |Sx|, the calculation of y, £, R, and S, which are defined towards the end of the current 
Section, will always be possible with this definition as well. 
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Using this notation, the rolling horizon time step shift of the entering past time step matrix 
ZP is given by: 
1, if k >1, and Dee ee = 
orif C = 2, k= k? = 1,and oP =a, 
Ze g= 
ek, Cote? kP ,ĝ orif > 2, k=1, k? > 1, and ZPrPrh =1 


e,k1,C—1,ofdp ,kP—1,6 T 


0, else, 


Vee SPP?) ke Sx, kP ESk, CES, oP, ES, (2.80) 
Elements of this sparse matrix are nonzero in the following three conditions: 


e The first describes the intuitive realization of the moving horizon for a water mass ele- 
ment that was already in the pipeline in the last time step k — 1, which has entered at a 
past time step kP. This element is shifted one position ahead. 


e The second describes the water mass which is at the second position (a of the regarded 
pipeline for the first time step k,. This water mass has entered the pipeline at the last 
time step k?, as the flow direction has not changed between k and k? °°. 


e The third condition is used to maintain the information about water masses which have 
entered in the past time steps kP”. As the approach updates the matrix elements in 
ascending order of the time steps k, without this step, the propagation of the information 
achieved through the first condition could not be accomplished. 


The definition of the amounts of time steps a respective water mass was in the pipeline can be 
calculated by increasing the value of the last time step by one. Only the water mass in the first 
position is regarded as just entering the pipeline and thus the current time step is not taken 
into account here. The resulting equation is given by: 


0, if¢ =1, 
Ke,k,c,ofap = Re eet +1, for¢ #1, andk = 1, 


Ke,k—1,¢-1,0fe +1, for Ç #1, and k > 1, 
Vee Spire, k ESk, CES, GES, (2.81) 


In Case A.2, also named insert and copy previous time step, when the flow direction on the 
flow direction path o¢P changes between two consecutive time steps, the pipeline storage 
parameters are assigned as follows: For the first position (1, measurement data or results of 
the last optimization are utilized for the parameter definition. Visually speaking these values 
are newly inserted into the model, see the water mass marked in orange in Figure 2.15. Addi- 
tionally, the values for all positions ¢ > 1 are assigned from the parameters already derived 
for the last time step (copy previous time step). 


°8 Note that this condition can also be understood as the transition of a nonzero matrix element (representing a 


water mass) from Z to ZP. 
Note, that as indicated by Definition 2.3 the index kı in ZPP"! refers to a different time step than ky in ZP. 
Precisely, these two indexes kı describe two subsequent time steps, as can be understood from Figure 2.16. 
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The parameters of the predicted water masses m are updated as follows for the first time step 


kı: 


[ek] for¢ = 1 
~>brh brh 
Me ky Cy ofr = Rn ta = pw ASS.) for ¢ =2 
m brh 
Me,kı,y—1,0fdP for =3 
Te,kı,¢,ofdp = bah £ = brh a 
e,kı,Cı ,ofdP or ¢ =2+ TVe,kı ,‚ofdr 
App” ASO Le 
App” ASO Le for ¢ = |S.| 
Vee Spire, CES, oP ES, (2.82) 
and as follows for all further time steps: 
Mer for¢ =1 
MMe k—14eq,0% — RECARO tan — PVA Le) for ¢ = 2 
Me,k-1,6,_1,0fdr fr =3 
m ,k,C,ofdp = an j 
ekb? Me,k—1,C1,0fdr for ¢ =2+ Ve,k-1,ofdp — 1 
App“ AT Le 
a pV ATL. for ¢ = ISe] 
VeeSpire, k>1leS,, (es, oP ES, (2.83) 


The values of the predicted water masses m for the first position Çı are updated with mea- 
surements or latest predictions resulting from the last optimization m. Then all parameters 
which can be copied from the previous time step are utilized. In this context, Definition 2.2 
has to be taken into account, as it concretizes the notation. For the second position ¢ = 2, 
the water mass from the previous time step Tie, k—1,¢,,ofp, is reduced by the amount of water, 
which has already left the pipeline. For this assignment the values of two further parameters 
y and RY™ are necessary, see Figure 2.12. The exact form of calculation of these parameters 
is given in equation (2.98a) and (2.99a). The first describes the position of the last water mass 
which is leaving the pipeline, in the respective time step and flow direction. The second de- 
fines the aggregated water mass of all water elements on the positions from the beginning of 
the pipeline up to the one determined by y. Note, that these parameters y and RY™ are always 
updated based on the current values of the predicted mass flows m. The last value, which can 
be copied is taken from the first position of the previous time step (1. All further predicted 
water masses for the positions Ç > 2+ Ye k—1,ofa» — 1 are then set to the value which fills the 
pipeline in a single time step x pW Avs Le. Again, this prevents the unexpected case, that 
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the pipeline could be “not completely filled” with water masses, within the model in case of a 
small number of positions |S¢| and low mass flows in the current and past time steps“. Also 
take into account the following aspects: 


e In the special case, that the water mass RY" is equal to the water mass of the filled 
P q 
ipeline, thus RY™ = p¥ ATL, the entire water mass m. p— fap is utilized for 
pip p e e,k—-1,¢,,0 


the new value of (3, as no water of Tihe,k-1,¢4,084 has left the pipeline in the previous 
time step. 


« If the current (inserted) mass flow is large enough in relation to the pipeline length L, 
cross section A®®® and time step length Ak, the pipe is filled by the mass flow of a 
single time step. In this case the predicted mass flows for the positions ¢ > 2 still need 


to be copied, as these values affect the result of the outlet temperature of the pipeline 
Tout2 


Further, the rolling horizon time step shift for Case A.2 of the entering time step matrix Z is 
given by: 


1, fC =1, k= k, and of® =5, 


a or if ¢ > 1, and k > 1, and Zk-1,6,0% kē =] 
u with ¢ =2+ Ye,k—1,ofdp — Ç, 
0, else, 
VeeSpire k kESrp (les. of? FES, (2.84) 


Elements of the sparse matrix are nonzero if either the element represents a water mass which 
is just about to enter the pipeline or if the element represents a water mass which was in the 
pipeline before. In this case the conditions (considering the entering time step k and entering 
flow direction 5) can be copied from the opposite flow direction which was present in the 
previous time step (on the FDP ) in the regarded Case A.261%, 


Remark 2.3: 


The index ¢ is used here, to determine the positions of the last time step, which are now “copied” to 
the current time step. Thereby, the i operator is chosen, instead of the previously used Ô operator 
within the indices of e.g. Z. This difference is chosen as the Ò operator refers to other time steps 
and flow directions, where the water masses entered the pipeline, while the operator indicates 
a certain position which is determined by the copying procedure. 


60 Theoretically, all predicted water masses M for the positions Ç > 2 + Ye k—1,øfdp — 1 + 1 could also be set to 


0 as they are not further needed for the approach in theory. However, defining them as in equation (2.83), also 
leads to feasible solutions of (2.98a) in the very unlikely case of previous and current mass flow values of Mao 
and numeric inaccuracies, e.g. if stop criteria of solvers would be loosened. 

Note that of4P is dependent on the time step here, as given in Definition 2.1 above. 

The used values of y are always updated, based on the new determined values of m in the assignment process. 
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The elements of the past time step entering time matrix ZP is defined by: 


1, ifk == kP =1, andG =24+ yh 6 
and Da = 1,and en = Gekı 
orifk > 1, and A hedges =Í 
Z keot kea = with ¢ =2+ Ve,k-1,0fdp — 6; 
orif Ç >1, k= 1, kP > 1, and ZPT ay gpg = b 
with ¢ =2+ eee = & 


0, else, 


VeecSpire kk Ee Sp, kP ESk, CES, of, ES, (2.85) 


For the following three cases the elements are nonzero: 


e First, visually speaking, a nonzero element can be transferred from Z to ZP in the first 
time step kı. This is the element which was in the first position (1 at the first time step 
kı before the rolling horizon time step shift. 


« The second condition for nonzero elements represents the copy from previous time step 
part for matrix elements of ZP. In this matter, the mapping of the respective positions 
is achieved by the condition Ĉ=2+ Ye,k—1,0%» — Ç, which is represented by the arrows 
in Figure 2.15. 


e The third and last case resulting in nonzero elements of matrix ZP enables to maintain 
the information of the earlier past time steps kP > 1 throughout the rolling horizon 
time step shift. 


The following Example 2.1 illustrates the provided equations (2.84) and (2.85). 
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Example 2.1: 


The regarded example is shown in Figure 2.17. As this is a visualization of Case A.2, the flow 
directions looked at within this example represent the flow directions on the flow direction 
path Os = o* and Coe = o`. The flow directions not on the flow direction path are 
shown transparent in Figure 2.17. 


Flow in edge direction o* Flow against edge direction 0” 


Q 1) 3 Ga s Ce Ce 5 a G Q A 


Figure 2.17: Example for Case A.2: Basic idea of approach if the flow direction on the flow direction path o!P 
within a pipeline e changes between two consecutive time steps k and k + 1. 


For this example it is assumed, that the Z and Z? are already updated for pipeline/edge e1, 
time step kz with positive flow direction o*. These values are shown in Figure 2.17 and below: 


ky ko ka ka ky ko ka ka 
& |0 0 1 0 & 10 0 0 0 
& J0 1 0 0 & |0 0 0 0 
Zeaksgotköt” G |1 0 0 Ob Ze rstotka- = G |0 0 0 of (286) 
G4 10 0 0 0 G4 10 0 0 0 
¢; 10 0 0 0 G 10 0 0 0 
Cs 10 0 0 0 6 10 0 0 0 
ki ke ks Ri k? ke k k 
GG |0 0 0 0 G 10 0 0 0 
10 0 0 0 5 & l0 0 0 0 
eika cot keat = G|O 0 0 Ob Zekat- = 63/0 0 0 of (287) 
G4}0 0 0 0 ĉ&, |0 0 1 0 
& 10 0 0 0 ĉ&s i0 1 0 0 
6I0 0 0 0 6 }1 0 0 0 
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Based on the above, the novel matrix Z and ZP entries for the next time step k4 with negative 
flow direction o~ are calculated with (2.84) as well as (2.85) and given by: 


ky ka ks k4 kı ko kg ku 
¢ fo 0 0 0 à foo 0 1 
& 10 000 & lo 000 
Zoko- kot Gl 0 0 0b Zeakco-ko-= & |0 0 0 of (288) 
Kloet Oo 4 1 Oo 00 
&lo010 &lo0 0 0 
610 0 1 6 & lo 00. 0 
kp ky k3 ky k? k3 k5 k? 
afooo0o à ooo o0 
& 6 000 & lo 010 
ekago- keat = (10 0 0 Ob Zoko- kea- G |0 0 0 of (289) 
&loo0o0 0 4 lo ie 
(; |0 0 0 0 ¢; |0 0 0 0 
& lo 0 0 0 & | 0 0 0 


Note, that the value Ye k—1 otav used in (2.84) to determine the new values of Z,, kaco- ko È 
given by Ye, ,ka,o+ = 4. Further, the same value is used in (2.85) to determine Z e, .x.,C,0- ‚kv,o- 
The blue marked entry is optional and represents the additional accuracy measure described 
in Remark 2.4. 
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The number of time steps a water mass was in the pipeline « is updated for the first time step 


ky by: 


0 for¢=1 
brh aa 
Roki ê ofàp +1 for =2 
gbrh . en 41 for ¢ =3 


e,kı Gy-1 3T 


Ke,kı,c,ofip = . : 
Kr, tt for¢= 2+ 9b 1 
0 
0 for ¢ = [Sel 

Vees CEES me Ss (2.90) 


and for all following time steps by: 


0 for¢ =1 
Kek-1,ĉ ot tl for¢=2 
Ke k—1,ĉ 1,0"? F 1 for¢=3 


Ke,k,C,ofap = ` ` 
A Ke k-1,€1 ofp +1 for ¢ =2+ Ye,k—1,ofdp — 1 
0 
0 for ¢ = |S¢| 
Vee spire, k>1ESz, les, FES, (2.91) 


As in equation (2.81), the elements in the first position ¢ = 1 of the pipeline are set to 0, while 
all further values are copied from the previous time step and increased by one. The values of 
all elements, which are not known as they can not be copied from the previous time step as 
Ç > 2 + Je k—-1,øfap — 1, are set to x = 0, as they also do not impact the calculation of the 


outlet temperature®. 


After all parameters on the rolling horizon have been newly assigned as given above, the 
parameters for all cases not on the flow direction path are updated based on the new values 
on the flow direction path as given below. 


63 In contrast to the assignment of the predicted mass flows min equation (2.83), no safety definition is performed 
here, as the value of x has much less impact on Tout2 as the values of m. 
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Case B: Rolling horizon time step shift of the pipeline parameters not on the flow 
direction path 

In analogy to Case A.2 stated above, the central idea of Case B is to insert and copy from the 
current time step, as shown in Figure 2.18. For the first position ¢; measurement data or results 
ofthe last optimization are utilized for the parameter definition. Then, values ofthe parameters 
for the positions C > 1 OFDP are copied from the parameters which have already been updated 
on the FDP. The main difference between Case B and Case A.2 is that parameters describing 
water masses of different parts of the “source pipeline” are copied in both cases. In Case A.2 the 
water masses copied from the previous time step are found in the positions ¢ < ¢,, describing 
all water masses in the pipeline up to the last water mass which is leaving the pipeline in the 
previous time step. While in Case B all water masses starting from the second position ¢2 up 
to the first water mass which is leaving the pipeline Çe in the current time step are copied. 
Following this principle the predicted water masses m are given as stated: 


Flow in edge direction o* Flow against edge direction 0” 


> Limit of water leaving < 
pipe in current k 


— + 


C1 2 ¢3 4 Cs 66 


Figure 2.18: Case B: Basic idea of new assignment of the pipeline parameters opposed to the flow direction path 
o°fdP for a time step k by inserting and copying from the current time step. Note that in this example 
ofdpP = gt and thus oPfdP = ø`. Further it should be kept in mind, that the amount of water 
flowing into the pipeline is equal to the amount of water leaving the pipeline at a certain time step, see 
Figure 2.12. An explanation of the water mass marked with T = 0 is provided later in Remark 2.4. 


[the,r] for¢ =1 

Me k È otar = Ar < kaiiv = PYAS Le) for ¢ =? 

Te kÈ _,ofip for Ç =3 

m ‚k, P ofdp = ~ ` ` 
e,k,C,o Me k, és,ofap for Ç = 2+ Ee,k,ofap — 1 

AEP” Across, 

Ap“ ASS Le for Ç = |Sc| 

Vee SPP?) kESk, GEES oP, oP ES, (2.92) 


Here, and in the following equations it is important to note that the flow directions are distin- 
guished as on the FDP gf% and OFDP o°@P. The predicted mass flow of the first position Cı 
is updated with the last values of the optimization or if available the respective sensors. Then, 
for the second position (>, the parameter is updated by subtracting the water mass S”"", see 
Figure 2.12, from the sum of the entire water mass of the pipeline po“ A'°*SL, and the first wa- 
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ter mass which is currently leaving the pipeline in the FDP case. This first water mass has the 
position £. The parameters £ and S”" are calculated with equation (2.98b) and (2.99b). Note, 
that e and S*™ are always updated with the latest values of m. All following positions with 
2 < Ç <2+€.% ota» — 1 are simply copied. In analogy to equation (2.83) the predicted water 


masses 7h are set to the mass flow, which is necessary to fill the entire pipeline within one 


time step x p% Ass Le in order to prevent model inaccuracies in case of numeric issues”. 


The elements of the entering time step and flow direction matrix Z are given as follows for 
Case B: 


L, if C = 1 and k = k and or = õ, 
orif Z 1 


Z fdp Lz = e,k,6 08 kg z 
e,k,¢,o°fdP ke with ¢ =2 + Eek, ofi? = ¢, 
0, else, 
Vee SPire, k keESp (les. oP, oP 6 ES, (2.93) 


Therein, the elements are nonzero if either a new element is inserted or if the elements are 
copied from the FDP of the current time step. In this context, the equation Č = 2+ Ee, Kotte — Ç 
maps the respective positions of the water mass elements in the pipeline model on the FDP and 
OFDP. An example for the determination of Z in Case B is provided in Example 2.2. The past 
entering time step and flow direction matrix ZP is defined similarly as: 


ce 7P = 
1, if 2 kÈ = 
A E = with ¢ =2 + Ee k,ofdp = Ca 
0, else, 
Vee Shire k kESr, kP ES, GEES, APP ses, (2.94) 


Note, that this updating process is simple here as only some information is copied from the 
FDP of the current time step therefore. Exemplary values are also given in the following Ex- 
ample 2.2. 
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Example 2.2: 


An example for Case B is depicted in Figure 2.19. Note, that the flow direction on the flow 


: : -fdp _ -+ 
direction path iso. p, = 0"- 
Flow in edge direction o* Flow against edge direction o” 


Figure 2.19: Example for Case B: Basic idea of new assignment of the pipeline parameters opposed to the flow 
direction path o°fdP for time step k3 by inserting and copying from the current time step. Note that 
in this example ofdP = o+ and thus o°fP = o—. An explanation of the water mass marked with 
T = 0 is provided in Remark 2.4. 


For this example it is assumed, that the Z and Z? are already updated for pipeline/edge e1, 
time step k3 with positive flow direction o*. These values are shown in Figure 2.19 and given 
in (2.86) and (2.87). Based on these, the novel matrix entries of Z and ZP for the opposed 
negative flow direction o~ are calculated with (2.93) as well as (2.94) and given by: 


a 
a 


ky v2 kg ka ky E2 ka ka 
& I0 0 0 0 ¢ I0 0 1 0 
6 I0 0 0 0 & I0 0 0 0 
eat Ca 10 0 O Ob Zeaksco-ko- = & |0 0 0 Of (295) 
Ga 11 0 0 0 C, 10 0 0 0 
Cs JO 1 0 0 Cs 10 0 0 0 
¢ JO 1 0 0 6 10 0 0 0 
k? kB RB ke k? kB RB RP 
¢ {0 0 0 0 & 10 0 0 0 
G2 I0 0 0 0 & [O0 1 0 0 
eat = 6J0 0 0 0) A Rete ee = & jo 0 1 Of (2.96) 
C, 10 0 0 0 Ca 10 0 0 0 
¢; 10 0 0 0 510 0 0 0 
6 10 0 0 0 6 10 0 0 0 


The value £e k otav used in (2.93) to determine the new values of Ze ks to- ko is given by 
Ee,,kg3,0+ = 5. Further, the same value is used in (2.94) to determine Ze, ks, ċ,o-,ke o The 
blue marked entry is optional and represents the additional accuracy measure described in 
Remark 2.4. 
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Also the values for the number of time steps a water mass was in the pipeline « are updated 
accordingly to the previous assignments in Case B: 


0 for¢ =1 
Ke k Č otip for ¢ = 2 
Ke k,€e_1,0%4P for¢ =3 


Ke, k,C,cofdp = ; 
Ke k Ča ofdp for C = 2 + €¢ x ofa» — 1 


0 
0 for ¢ = |Se| 
VeeSPpire, kes, CES oP, cM? ses, (2.97) 


The values of « for the new inserted water masses on position ¢ = 1 are set to k = 0, while 
all further values are copied as in the earlier assignments of Case B above. 


Remark 2.4: 


When copying water masses from the current or previous time step in Case A.2 or Case B some 
water masses outside the newly assigned pipeline, will possess the temperature value T = 0. An 
example of this case is shown as the white water mass in Figure 2.18. In theory, the approach 
will always provide sufficiently filled pipes as well as out flowing water masses with accordingly 
assigned node temperatures to enable an accurate calculation of the outlet temperature of the 
pipelines T°™?. However, in case of numerical inaccuracy of the calculation of the outlet tem- 
perature of the pipeline, a small fraction of the last water mass with T = 0 could be used by 
the approach. The resulting error through this effect is neglectable. Still, for example if larger 
solver tolerances are to be used, this effect can be simply reduced. Therefore, visually speaking, 
the temperature is kept constant at the end of the pipeline, as soon as no temperature values are 
known any more. This is done by setting the last water masses of the pipeline model, which would 
usually not be set (thus T = 0), to the temperature of the last known water mass temperature. 
This would be the dark red water mass to the right of the white water mass in Figure 2.18. In this 
case all values of Z and ZP, which do not have a nonzero entry, over all dimensions for a certain 
position Ç € Sc, are set to the last set time step k or kP. See Example 2.1 for an illustration. 


In summary, the above explanations described how the pipeline parameters Z, , - , j.,5> 


Zee Merle and Ke,k,¢,o are updated the realize the rolling horizon time shift. The 
matrices Z and ZP? are used to assign the respective (past) node temperatures to the water 
masses in the pipelines. As explained in the upcoming paragraph the mass flow values mare 
used to determine the weights w used to define which out flowing water mass should be taken 
into account by which percentage in the weighted sum used to calculate the lossless outlet 
temperature in (2.70). Further, the parameters x, which describe the amounts of time steps a 
water mass was in the given pipeline, are used to calculate the length of stay of the leaving 
water mass. 
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Calculation of Pipeline Parameters Dependent on Updated Values of m and x of the 
Water Masses Based on the newly calculated stored mass flow values mn. ‚x,c,o, the pipeline 
position parameters Ye ko; Ee,k,o are updated as defined below: 


Ye,k,o = minfa x 5 (Merco Ak) > pV ATO Le, 
x ze 
eT, rea} Vee SPP k € Sp, 0 € So (2.98a) 
Ee,k,o = ninfa : > (Merco Ak) > pV AT Ly, 
z = 
222, zez), Ve € SPP? k E€ Sp, € So (2.98b) 


An intuitive understanding of the positions defined by these parameters can be obtained from 
Figure 2.12. The pipeline position parameter y defines the temporally seen last water mass 
leaving the pipeline e in the current time step k for a given flow direction ø. Analogously 
the position e defines the first water mass leaving the pipeline. Based on these values also the 
auxiliary water masses RY% o and SYk o can be calculated as stated: 


e,k,o’ 
Ye,k,o 
RP= (thengaAk), VeeS, kESho ES (2.950) 
¢=1 
Ee,k,o—1 
en 
eko = Fa Ve E SPP? k € Spo € So 

ceko > Ye,k,o + 1 
es else, 


(2.99b) 


Regarding Figure 2.12 it is understood, that RY™ defines the aggregated water mass of all water 
elements on the positions from the beginning of the pipeline up to the one determined by y. 
Similarly the auxiliary water mass S“™ is defined by the position £ — 1. Taking into account 
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wm 


the parameters Yeko, Ee,k,o» RSF o» and also the weights can be defined we x,c,o as: 


e,k,o 
1 win wy ASTOS 
We,k,C,o = Ties lAK | ako — P Ae Le), 
e, 
if = Yeko, Ve E SPP: k E Sp, a E So, (2.100) 
1 > 
We,k,o = Imp Ak MercolAk) 
e, 
if Yeko < C < Eek, Ve € SPP? k E Sp, 0 E So (2.101) 
MAR (\me,k|Ak + pP" AF Le — Boman 
a if Ç = Ee k,o and Yoko < Eeka, VE E SPP., k E€ Sk, 7 € So, (2.102) 
e,k,¢,o mrar (Me, |Ak 4 pr aAor De fine BI.) + Dear; 


if Ç = Ee,k,o and Ye,k,o = Ee,k,o, VEE Spipe, k € Sk, o E€ So 


Using these weights w, the length of stay within the pipeline te k o of the leaving water mass 
can be calculated by a weighted sum, as: 


€! 
te,k,o = ee + 5 We,k,C,o Re,k,C,o + We,k,e,oKe,ke,o) Ak 
Ç=7y+1 
E 
= (So wekg oke kto] Ak, Wee SPP k E Spo E So (2.103) 


=y 


Therein the values of x represent the amounts of time steps a certain water mass was in the 
given pipeline. 


Based on the newly calculated weights w and the length of stay t, all parameters are given 
to calculate the lossless outlet temperature of a pipeline T°"*! with (2.70) as well as the lossy 
outlet temperature T°? in (2.71). Thereby, the entire thermal pipeline model is provided. 


Upper Bound of Possible Modeling Errors This section determines an upper bound of 
possibly occurring errors from the above described thermal pipeline model. The accuracy of 
the presented model is dependent on the quality ofthe predicted mass flow estimates in. These 
predicted values are then used to calculate the weights w, which then determine the length of 
stay of the water masses in the pipeline t and the outlet temperature T°"*?. In case of perfect 
flow predictions, the presented model accuracy equals the results of the NM, showing very 
small RMSEs of 0.507°C [MRMH21], as stated above. In case the predictions show deviations 
from the actual flow conditions within the DHN, an upper bound of the possible modeling 
error AT), dev for a given pipeline e and time step k can be derived as follows. Therefore, 
the maximal deviation of the actual temperature measured at the outlet of a pipeline T™°*S 
and the results of the simulation based on the flow direction Tee or T is used. Next, 
T°? is replaced by the possible minimal or maximal temperature values, which can occur 
at the outlet of the pipeline. These are the minimal or maximal values of all past or current 
node temperatures T; ke or T; ;,,, of all nodes 7 bordering the respective edge e, thus fulfilling 
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the condition | A¢2"| > 0. Note, that the minimal outlet temperature values are calculated by 
taking into account the largest possible losses over the pipeline, thus using the longest possible 
length of stay of a water mass t™?*. The formal expression is: 


a max (Immer — Tey, | Tee — Te) 
< mag, (ITE -Tah ITE ul 
y resi max 
with |AŢ3P|>0, g ek 
kESr, aa le (T, — T°) exp G Te DE 

BI pmax 

ik 
meas _ (Ta + (Tip — T*) exp ( — I), 
e 
Vee SPIP, k € Sy (2.104) 


The upper bound of possible modeling errors, can be approximated by the product of the time 
interval and the maximal gradient of temperature changes at nodes in DHN operation which 
are in the range of 3°C/h [MMW 20] and 2°C /min [Rat19, p.25-26]. In general DHN opera- 
tors are interested in keeping these gradients small to prevent fast aging of the pipe insulation 
material [MMW*20]. When carrying out parameter studies to evaluate the model accuracy, 
the quality of the mass flow predictions is of high interest, as they directly impact the outlet 
temperature of the pipeline. These predicted mass flow values originate form the last opti- 
mization of the rolling horizon approach. Thus, in [Tsc19] a comparison of the lossy pipeline 
outlet temperatures, based on the predicted mass flow values, with the exact mass flow values 
for a small DHN with fixed mass flow directions was performed. The predicted mass flows 
were obtained from the rolling horizon optimization ofthe last time step, while the exact mass 
flow values resulted from the mass flows obtained from the current optimization. Based on 
this, it can be seen, that the amount of time steps included in the prediction horizon largely 
impact the accuracy of the predicted mass flow values and thus the outlet temperature. For 
a prediction horizon of 1 time step, see Figure 2.20, the deviations are below 4K within the 
entire DHN except for a single time step, where the maximum deviation of 10.22 K is reached 
at Node 8. For a larger prediction horizon of 14 time steps, see Figure 2.20, the maximum error 
falls below 1.5 K and even 0.1K after the stronger deviations created through the initializa- 
tion of the rolling horizon approach. Further, in [SWW*19] it is reported, that mass flow 
predictions with maximum errors in the mean values of 1 % and 6 % in the standard deviation 
can be obtained. All in all, the given upper bound, the parameter study and the cited literature 
indicate that temperature deviations will most likely be in the lower single digit range. Further, 
the presented simulation results show the salient features of the combination of the presented 
thermal pipeline model with the rolling horizon approach, which will be presented in detail 
in Section 3.3. Through the rolling horizon approach, the quality of the predicted mass flow 
values will most likely increase toward the current operation time for a sufficient prediction 
horizon. Besides, within this model no additional numeric effects, as dispersive and dissipa- 
tive errors, cause additional deviations as this is the case e.g. for finite difference DHN pipeline 
modeling approaches [MRMH21]. 


70 2 Modeling of Coupled Electric Power and District Heating Networks 


Temperature deviation in K 


0 3 6 9 12 15 18 21 24 
Time inh 


Figure 2.20: Deviation between the exact simulated temperature and the one calculated from the proposed pipeline 
model for 1 time step on the prediction horizon. 
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Figure 2.21: Deviation between the exact simulated temperature and the one calculated from the proposed pipeline 
model for 14 time steps on the prediction horizon. 
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2.4 Summary and Discussion 


CEPDHNs are complex large systems that result in extensive network models. The model 
presented in this chapter can be represented as a nonlinear system of algebraic equations: 


h(x) =0 (2.105) 


For that matter (2.105) is constructed by stacking the presented equations of all CEPDHN com- 
ponents for all time steps. Precisely, these equations are (2.11), (2.12), (2.15), (2.16), (2.17), (2.21), 
(2.23), (2.24), (2.26), (2.28), (2.29), (2.30), (2.31), (2.32), (2.33), (2.34), (2.35), (2.36), (2.39), (2.42), 
(2.43), (2.44), (2.45), (2.47), (2.49), (2.51), (2.52), (2.53), (2.54), (2.56), (2.57), (2.58), (2.59) , (2.60), 
(2.61), (2.62), (2.63), (2.64), (2.65), (2.66), (2.70), (2.71), (2.72), and (2.73). 


Before this system (2.105) can be simulated/solved, based on an initial value xo, several in- 
put parameters need to be provided. These are the network parameters, the power injections 
or demand of all NPs, the set points of pumps and valves, and the parameters needed for 
the pipeline model. This shows, that in general the proposed model could also be used for 
simulating CEPDHNs. Still, this model was especially developed for application within opera- 
tional optimization. This new CEPDHN model incorporates difficult aspects which are usually 
neglected within operation optimization of CEPDHNs, as: VFVT operation of DHNs includ- 
ing the effects of pipeline storage, VMFDs, control paths of pumps and differential pressure 
regulators, pipeline friction factor calculations based on close approximations of the Prandtl- 
Colebrook equation, and the full AC power flow. 


As it can be seen from literature cited with the proper network element models, the presented 
high detail CEPDHN model is the result of a customized combination and extension of ex- 
isting models. The most relevant works, with the largest impact on the provided network 
representation (2.105) are [Trö99, Opp15]. Note, that the model in [Opp15] was designed 
for simulation purposes. Thus, the model is not continuously differentiable as it relies on 
conditions, which need to be checked during the solution process. Further, this work does 
not incorporate EPNs and is based on the assumption of fixed flow directions. The model in 
[Tr699] neglects control paths and differential pressure regulators, and the EPN is modeled 
as a single bus. Also both approaches [Tr699, Opp15] do not provide TESS models, and use 
deviating thermal pipeline models. The contributed thermal pipeline model, first presented in 
this work, is built upon the node method which was first presented in [Ben91]. Combining 
this with ideas from [LWS* 15] and [Tr699] as well as further improvements of the author, as 
stated in Section 2.3.3, led to new thermal pipeline model, which enables to take VMFDs into 
account. Further, as shown towards the end of Section 2.3.3 the thermal pipeline model profits 
from the operation principle of a rolling horizon approach, as the predicted mass flow values 
used to calculate the output temperatures tend to become more and more precise the closer 
the regarded time step is to the actual point in time. This is of importance as the propagation 
of the temperature fronts through the DHN pipelines are the only physical effect, that needs to 
be modeled through dynamic models, in the context of operational optimization [ZWWT 21]. 
In total this CEPDHN model is the central element of the model based control approach of the 
TCS presented in the following chapter. 


72 2 Modeling of Coupled Electric Power and District Heating Networks 


The comparatively high modeling detail ofthe presented CEPDHN model has two salient fea- 
tures. First, it enables a technically efficient form of CEPDHN operation. This is achieved by 
representing variable flows and variable temperature operating conditions, which are the core 
of the most efficient form of DHN operation [DLSt19, ZZZW18a]. Also the consideration 
of VMFDs, pipeline storage and the losses occurring in EPNs and DHNs account for tech- 
nical efficiency, when considered within optimal operation approaches. Second, the afore- 
mentioned modeling detail has a direct effect on the possible solution set of market-based 
operation approaches, and thus on the maximum achievable welfare result. Since, for example 
preventing VMFDs can have severe consequences on the objective value/market outcome, see 
Section 1.2.5. In summary, the detailed CEPDHN model forms Contribution 2 of this work, 
bridging the element 1. a) of the research gap stated in Section 1.2.5. 


3 Transactive Control System Design 


This chapter outlines the specific methods used to design the TCS for CEPDHNs which is 
the central contribution of this work. Therefore the general system design is presented in 
Section 3.1. Therein, the different entities which are part ofthe presented approach are stated 
and their actions and information exchange are outlaid. This comprises the basic market and 
control mechanisms applied by design. A detailed description of possible and the selected 
market mechanisms is than given in Section 3.2. The subsequent Section 3.3 describes the 
control mechanisms, specially designed for the novel TCS. Parts of this chapter have been 
published in [MTK*22], [MGR* 21], and [MIJSH22]. 


3.1 System Design 


Within this section, the big picture and basic functionality of the new TCS system design, 
proposed in this work, is introduced. Note, that parts of the descriptions in this section have 
been previously published in [MTK* 22]. For the optimal economic operation of CEPDHNs, 
FNPs should be operated in a way that maximizes social welfare [ZXL* 17]. To this effect, an 
intraday TCS auction market‘, activated after settlement of a day-ahead energy market, is 
assumed® to coordinate the interests of all FNPs. The proposed intraday energy market is 
auction based and considered within the Independent System Operator Energy Management 
Systems (ISOEMSs), which are designed using a distributed rolling horizon approach, described 
in detail in Section 3.3. Therefore, the ISOEMSs take into account all necessary information 
as the nonlinear dynamic and stationary network models, operational constraints, predictions 
of power supply and demand of inflexible units, and bids of FNPs to determine the optimal 
control values/dispatch solutions that maximizes social welfare and ensures secure network 
operations? at the same time. Note, that the ISOEMSs therefore solve a nonlinear optimization 
problem in a parallel but coordinated manner in order to enable real-time implementation of 
this large scale dispatch problem. This indicates the necessity of a prior decomposition of the 
entire market clearing dispatch problem into multiple subproblems. As will be discussed in 
detail in Section 3.3.2, this decomposition is performed by decomposing the CEPDHN network 
into multiple operation zones®. Note, that the dispatch solution of the distributed ISOEMSs is 
the same as it would be calculated by a single ISOEMS for the entire CEPDHN. Thereby, the 
proposed market and control mechanisms, which are briefly presented in this section and 
discussed in detail in the following Sections 3.2 and 3.3, are integrated into a new TCS to 


64 Precisely, this market represents the integration of an electric intraday market and a heat intraday market for ev- 


ery DHN which are all cleared in a coordinated joint simultaneous procedure, as explained in detail in Section 3.2. 
See Assumption 3.3 for more details. 

The term operation zone is utilized here in order to enable to distinguish between operation and price zones in 
the following. 
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Figure 3.1: Proposed approach showing information flow between the two hierarchy levels of the TCS, i.e., the 
ISOEMS (TCS Level II) and the EMSSAs of the FNPs (TCS Level I), and the energy supply and demand of 
flexible and inflexible network participants connected to the CEPDHN. 


optimally operate CEPDHNs. An overview of the proposed TCS is shown in Figure 3.1 for 
the case of a single ISOEMS, and in Figure 3.2 for multiple distributed ISOEMSs. The basic 
procedure of the TCS can be described as follows: 


1. Every Energy Management System Software Agent (EMSSA) ofan FNP n taking part in 
the TCS auction market sends its bids/offers c„ to the ISOEMS in charge of its proper 
operation zone‘. Additionally, predictions of further power infeed and demand of all 
Inflexible Network Participants (INPs), as defined in Assumption 3.1 below, and oper- 
ational parameters as e.g. pump and DPR set points, are sent to every ISOEMS by the 
network operators. 


2. All ISOEMSs calculate the optimal control values P, and ®,, in a parallel coordinated 
form, for all FNPs of the CEPDHN maximizing the social welfare W, while taking into 
account the operational limits of the CEPDHN. Further, the resulting market prices are 
determined by the ISOEMSs. Then, the control values and the market prices are sent to 
the EMSSAs of the FNPs . 


This procedure is repeated for several time steps, based on a rolling horizon approach of the 


NMPC [Grii17]. The bids/offers, predictions, and control values are sent and determined for 


all time steps of the prediction horizon®. 


67 Every energy converter is modeled as an FNP in the EPN and DHN. Thus, when an energy converter is located 


at the border of an operation zone, as shown in Figure 3.2 the EMSSA of this energy converter sends bids/offers 
to ISOEMSs of both bordering operational zones. 

FNPs are incentivized to keep bids/offers for a specific time step constant over the prediction horizon to avoid 
penalty fees. However, the proposed approach can also handle cases where FNPs change their bids/offers over 
time. 
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Operational zone border 


L] ISOEMS 


O EMSSA 


— - — = Information exchange 
between ISOEMSs 


Figure 3.2: Multiple ISOEMSs, each in charge for the operation of its proper operational zone, dispatching the 
CEPDHN and thereby clearing the intraday TCS auction market in a coordinated form. All elements 
of the CEPDHN not explained in the given legend are labeled in the legend of Figure 2.1. 


The proposed TCS intraday auction market is distinctly different from the traditional whole- 
sale energy markets. This is due to the fact, that the proposed TCS auction is a multi-period 
combined auction of two or more coupled market platforms associated with the EPN and every 
DHN, respectively, where these markets are cleared in a coordinated manner and simultane- 
ously. 


The energy dispatches in the proposed TCS auction market, operating in 15-minute intervals, 
change for every time step using a rolling horizon technique, in order to optimally adapt to 
the updated forecasts of supply and demand of inflexible network participants. The bids and 
offers of the FNPs are assumed to be provided by local EMSSAs, such as existing facility Energy 
Management Systems (EMSs). These automatically send bids to the ISOEMS for each time step 
based on the calculated flexibility of their respective facility, such as offices, factories, Battery 
Energy Storage Systems (BESSs), and/or energy hubs. Observe that these bids and offers are 
only known to the individual market participant and the TCS auction market operator, thus 
enhancing privacy as defined in [KW16]. No other information such as indoor temperatures, 
state of charge of batteries, or electric vehicle data is shared. Note, that privacy is a direct 
outcome from the information sharing specifications in the proposed TCS. Other approaches, 
such as direct load control [LLJZ20], which coordinate flexible resources based on monetary 
incentives, require sharing information not needed in the presented TCS. 
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The flexibility of consumer facilities can be determined by their EMSSAs by first calculating 
the predicted minimum power demand for the next hours and the expected usable amount of 
energy [AB19]. Based on these, two profile bids with minimum and maximum power values 
can be calculated. The bid prices of the FNPs are determined by their respective EMSSAs using 
an approach such as [AW14b]. 


As stated above, the network operators provide predictions to the ISOEMSs, this leads to: 


Assumption 3.1. Sufficiently accurate predictions on the aggregated electric real and reactive 
power infeed or demand, P, and Q, of all INPs connected to a specific bus in the EPN, can be 
provided for every time step on the prediction horizon. Similarly predictions on mass flows m, 
differential pressures Ap and temperatures T of DHN network parts affiliated to INPs can be 
provided. 


Projects and literature showing the effective prediction of electric power values at single distri- 
bution network buses are given e.g. by [ZSL+17, Sau19]. Besides this practical insight, several 
approaches can be found within the SOTA, that enable high quality predictions based on mea- 
surement data of sensors within the network smart meters at single NPs [MAFH21, WCHK18]. 
Two additional remarks are necessary here: 


Remark 3.1: 


For notational simplicity and without loss of generality, within this work it is assumed, that all 
NPsn € Sn are FNPsn € S™P, and so Sp = S{"P. Further, this entails the set of all INPs is empty 
Sup =o 


Remark 3.2: 


The presented TCS approach” is seen as incorporated into the current form of EPN and DHN oper- 
ation. This means earlier cleared markets and energy trading forms, as e.g. the day-ahead market, 
futures or Over the Counter (OTC) trading, define the UC . Further, ancillary services as e.g. fre- 
quency and voltage regulation in the EPN are present [MBB11]. Similarly in DHNs pressure and 
expansion maintenance is operating, and the controls of DPRs and pumps are active [NTJK20]. 


3.2 Market Mechanisms 


In this section the market mechanisms used within the context of this work are presented. 
These are the auction design and market clearing procedure, the allocation objective and the 
selection of an adequate pricing mechanism. Before these are depicted in detail below, the 
following assumption is introduced and discussed: 


Assumption 3.2. An intraday heat energy market is implemented in DHNs, if these have a 
sufficient large amount of MPs in order to limit issues related to market power. 


6° With the exact definition of a single ISOEMS presented later in Section 3.3.1 or multiple ISOEMSs outlaid in 
Section 3.3.2. 
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Note, that this assumption is widely used within literature [LWM* 18, ZGX13, LSZW15] due 
to the following reasons: 


1. In DHNs with large amount of small Distributed Energy Resource (DER) infeed, e.g. 
from CHPs, DHN operators are more and more confronted with uncoordinated heat 
power infeed, impeding efficient network operation. Here an appropriately designed 
DHN market would help to coordinate different supply forms (and demand). 


2. As pressure raises to save resources and reduce emissions, more and more smart meter 
systems are installed in DHNs, which would facilitate the implementation of real-time 
pricing mechanisms [LSZW15]. 


3. Currently, the DHN intraday market is not highly competitive, due the missing price 
variations of conventional energy carriers [CWL™ 18], which are currently used to a 
large extent for heat generation. Nevertheless, with the need to decarbonize heat supply, 
this entails a strong electrification of DHN supply, which will bring along larger intraday 
price variations due to the volatility of RESs [CWL™ 18]. The coordination of supply and 
demand is thereby supported by an adequate auction design. 


4. Besides the academic discussion about DHN markets, real world implementations of 
DHN intraday markets are already found in e.g. in Copenhagen [ZWW* 21]. 


Therefore, DHN markets could play an important role in future CEPDHNs, and are thus as- 
sumed in operation within this work besides a well known electric energy intraday market. 


3.2.1 Auction Design and Market Clearing 


When two or more partly coupled energy markets are cleared, here the EPN and multiple 
DHN markets”, these markets are either cleared sequentially or simultaneously in the pre- 
vailing approaches found in the respective literature [MKP20, DLS* 19]. In the case of market 
based operation approaches for CEPDHNs sequential market clearing approaches typically 
clear the EPN market first, and then clear the DHN thereafter. Unfortunately, this proce- 
dure creates cross-subsidies and limits the feasible allocations of the secondarily cleared mar- 
ket, thus limiting market efficiency. This happens e.g. when using the Alternative Power 
Method (APM) implemented in Sweden and Finland [DLS* 19]. Simultaneous market clearing 
approaches enable to overcome this downside. However, this is only achieved through infor- 
mation exchange between the Independent Market Operators (IMOs) of the different markets 
during the market clearing procedure. The TCS presented in this work is built upon a simul- 
taneous market clearing procedure. 


Here, a double sided multi-period combined auction is used for all markets within the TCS in 
order to enable DSM. The market clearing for the EPN and all DHN markets is simultaneously 
performed for every time step. The time interval Ak between to consecutive time steps is 
thereby set in the range of current intraday markets, thus within 5min < Ak < 15min 
[Ott03], [KP17]. Therefore, bids and offers for the entire prediction horizon are taken into 
account, but the market clearing is only carried out for the previous time step. The MPs are 


70 One for each DHN. 
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incentivized to keep their bids and offers constant, in price and power quantities for a specific 
time step, during the rolling horizon time step shifts in order to prevent penal fees. 


3.2.2 Allocation Objective 


The allocation of the multi-period combined auction is derived, based on the welfare W max- 
imization. The latter is defined as the sum of the benefits of all EPN and DHN consumers 
n € Shen andn € stdin, and net costs of all EPN and DHN producers n € S*°P? and 
n € S84 for all time steps on the prediction horizon k € Sx, given as follows: 


W = > | 5 Cn,kPnsk + 5 Cn kPn,k 


kESk "mesdern nEs Pa 
a > Cn, kOn,k a > cna (3.1) 
nesgo» nesha 


where the bid or offer price per unit is defined by c„ [MCC05], the electric real power in- 
jection is given by P and heat power supply is stated as ®. Note, that consumer powers 
can only become negative signs in equation (3.1), while producer powers, and all costs have 
positive values. Storage units may appear either as a consumer (when charging) or as pro- 
ducer (when discharging), and inflexible participants are considered to provide a zero-priced 
bid/offer, Cn, = 0. The ECs of the CEPDHN submit a DHN offer and an EPN bid/offer depend- 
ing on their type. For example EBs will send EPN bids while CHPs, supplying also electricity, 
will submit an EPN offer for every time step. 


Remark 3.3: 


More complex cost functions, e.g. piecewise linear functions resulting from the approximated 
efficiency curves of generators can be integrated directly into the approach presented here. An 
FNP can submit multiple bids or offers, one for every segment of the piecewise linear cost func- 
tion. The allocation based on the optimization of equation (3.1) ensures that the bids and offers 
are allocated successively, e.g. first the lowest priced offer of generator/FNP n, then the second 
lowest priced offer and so on. For notational simplicity and without loss of generality this work is 
restricted to a single bid or a single offer for consumers and producers. 


3.2.3 Pricing Mechanisms 


Four common pricing approaches used to clear energy markets are presented below. These 
are discriminatory pricing, uniform marginal pricing, zonal pricing and locational marginal 
pricing. After that, a fifth pricing approach, named as Hybrid Pricing Approach (HPA), devel- 
oped within the context of this thesis, for the application in CEPDHN market environments is 
introduced. For that matter, potential benefits and drawbacks occurring by the application of 
these different pricing methods are presented. A discussion and selection of a pricing approach 
for the presented TCS is then given after the description of all five pricing methodologies. 
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Discriminatory Pricing 


Following a discriminatory pricing approach the market participants will by paid as bid. The 
motivation behind this form of pricing is that producers with low energy production costs are 
supposed to submit low bid prices and will thus be paid low. Following this logic, this would 
increase the auctioneer’s and consumers welfare at the suppliers expense [HL12]. However, 
the fundamental problem behind discriminatory pricing approaches is the missing incentive 
compatibility, due to the opportunities for strategic behavior [SBLS04]. This pricing approach 
is e.g. used in Iran [HL12]. 


Uniform Marginal Pricing 


The Uniform Marginal Pricing Approach (UMPA) relies on insignificance of congestions 
within the regarded market area [MSC03], this is often referred to as the “copper plate” 
assumption [CN17, p. 34]. In the tradeoff between market liquidity and price efficiency, 
UMPA enhances market liquidity [MSC03]. 


One-shot auctions using the UMPA are proven to be incentive compatible [Vic61, ACP* 14]. 
The Uniform Marginal Price (UMP) is thereby calculated as follows: The IMO aggregates all 
supply offers into one marginal cost function f*(a*) by applying the Merit Order (MO). The 
supplied power of all producers of this allocation is given by x*. Similarly, the demand bids 
are aggregated vice versa into the marginal cost function f(a“), dependent on the power 
demand x“ of all consumers for the regarded allocation, and both are matched. Assuming 
an unconstrained lossless network, the intersection of the marginal supply and demand bid 
cost functions f*(a*) and f(x) define the UMP c'™P7!, and the total amount of power 
units traded U""P72, In this case, incentive compatibility is ensured because no benefit can 
be achieved by submitting offers higher than the actual cost value for a producer [SRG08a], 
and likewise in a double-sided auction, this also prevents consumers from submitting bids 
with costs lower than their real costs. This is due to the fact, that by submitting bids or offers 
with their marginal costs, MPs will either increase their revenue, or will at least receive their 
necessary utility. Therefore, in a sealed bid AD with uniform marginal pricing, the participants 
are incentivized to reveal their marginal costs [Nou95]. 


In the case of occurring system contingencies, UMPA causes false incentives through inad- 
equate price signals, necessitating command and control interventions in order to maintain 
secure network operation, see [MSC03] for examples on strategic behavior of the MPs. This 
procedure stands contrary to the desired form of competitive markets, reducing market effi- 
ciency due to uplift costs[MSC03]. In Germany, these redispatch costs have risen in the past 
decades and exceeded 900 million euros in 2017 [Bun18b]. 


71 Note, that in the unconstrained lossless Security Constrained Economic Dispatch (SCED) case, the UMP is equiv- 


alent to the energy component of the LMP presented below. 
A definition of the UMP in special cases as an overlap of fS(a°) and f¢(a%) for multiple points is given in 
[Zim10]. 
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Zonal Pricing 


The Zonal Pricing Approach (ZPA) is used in energy markets in Denmark, Sweden, and Nor- 
way [HL12]. In case congestions only occur on very few transmission lines between prede- 
fined price zones which can be appointed a priori, zonal pricing is a valuable alternative to 
UMPA. Advocates of this approach invoke the simplicity of the procedure compared to the 
much more complex LMPA”, and that the networks in many cases can be divided naturally 
into the respective price zones [HL12]. Still, as soon as intra zonal congestions appear, the 
problems of zonal pricing are equivalent to those of the UMPA, within a zone, again leading 
to the socialization of uplift costs [MSC03]. Further, real world experience shows, that itis a 
tough and nontrivial task to predefine adequate price zones. This originates from the fact that 
congestions are often not rare and do not follow clear spatial patterns [MSC03]. 


Locational Marginal Pricing 


For electric energy market price signals, the LMPA was first presented in [CBS82]. For 
EPNs the LMPs can be obtained from the dual variables of the power balancing constraints 
(2.15)’*. Every single LMP \‘°* consists of three price components, the energy price 
Acner8y_ the congestion price A°°?, and the loss price components \!°**, given as: 
=O HN HA, VieS,kes, (3.2) 
Thus, At% expresses the marginal cost to provide the last increment of electric power at a 
specific bus iin the EPN [MSC03] for a respective time step k. The LMPA inherently overcomes 
the inefficiencies of the UMPA and the zonal pricing approaches. It comprises uplift costs 
by directly taking congestions into account, reflecting these in the nodal prices. Hence, the 
approach inherently calculates optimal price zones for every dispatched solution, which can 
vary in size from a single node up to the entire network. Multiple studies, listing a slight 
superiority, by 0.8% to 1.5 % welfare increase, of the LMPA compared to UMPAs are stated 
in [HL12]. Also studies showing the superiority of the LMPA in contrast to ZPAs are listed 
in [HL12]. A major advantage of the LMPA is the ability to provide investors with incentives 
to construct and connect flexibilities at suited buses [MSC03], and thereby reduce congestion 
and loss costs”. However, the LMPA cannot fully prevent strategic behavior and the obtained 
prices can be dependent on the chosen reference bus [NAB14]. 


In MES the concept of LMPAs has been applied within the given literature [GA07, DLSt 19]. 
For a DHN, the dual variables of the thermal node equation (2.45)’° reflect the LMPs. Note, that 
the thermal node equation needs to be multiplied by the specific heat capacity of water c” be- 
fore, to obtain properly scaled values for the LMPs. In the case of dynamic network models, as 


73 Which is introduced below. 

74 If the LMPA is implemented within distribution networks, it is often referred to as Distribution Locational 
Marginal Price (DLMP) [HCC* 12]. Thereby, losses should be taken into account, as they are larger as in trans- 
mission systems [CWL* 18]. The AC power flow equation (2.15) used in this work is thereby often suggested 
within the literature, see e.g. [OCS04, Hcct 12, MC11, CWL+ 18]. 

It should be noted, that changing the pricing mechanism to LMPA in the European Energy markets would need 
high political effort. 

76 Or (2.47) in the case of VMFDs. 
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often occurring in optimal dispatch problems of DHNs, the LMPs are also dependent on time 
delay effects [DLS*19]. The time delay can influence all three components of the LMPs men- 
tioned above. These time delay effects still conform with the basic principle of the LMPs, as it 
charges MPs by the truly arising costs at a specific location in a certain point of time [DLS*19]. 
However, in DHNs, as FNPs are always connected to supply and return networks, applying the 
LMPA results in two possible LMPs for every FNP. Furthermore, these two marginal prices for 
an FNP can differ, due to different constraints applied to the DHN nodes. This happens, e.g. in 
the context of limiting the temperature ranges of supply and return nodes [MTK™ 22]. Thus, 
the assignment of an LMP to each FNP within TCS for (CEP)DHNs remains an open question. 
In the current form, the LMPA is not suitable for DHNs, as it is not possible to identify a clear 
buying/selling price for every FNP. 


Hybrid Pricing Approach 


The description of the HPA is based on the authors previous work [MGR* 21, pp. 4-7]. The 
basic idea behind this approach is to aim for incentive compatibility, and maximize allocation 
efficiency, while preventing uplift costs due to redispatch. Therefore, in the HPA, uniform 
marginal pricing is mainly used as it ensures incentive compatibility but also considers net- 
work restrictions within the dispatch procedure. However, in the case of network congestion, 
pure uniform marginal pricing is not incentive compatible, as explained below in this section. 
Therefore, a fraction of the bids and offers, which exceed U"™P4, the amount of power traded 
at the Uniform Marginal Price obtained from Dispatch (UMPD) c?™?“, are then priced via paid- 
as-bid and pay-as-bid vice versa. The UMPD is defined, as the intersection of the dispatched 
consumer and producer bid and offer curves, and not by the intersection of the submitted con- 
sumer and producer bid and offer functions, in order to take network congestions into account. 
For simplicity reasons, first lossless energy networks of any domain are assumed. 


Remark 3.4: 


It is important to distinguish between the UMP c™™P obtained from the UMPA introduced in 
Section 3.2.3 and the UMPD c¥%™P¢ resulting from the dispatch taking network congestion into 
account. Therefore the UMPD cP‘ is written with an additional "d" for dispatch in the following. 
Note that, in the case of an uncongested network c¥™P = c¥™P4 always holds. 


After the allocation of the power traded between all MPs n, also known as dispatch procedure, 
the prices paid by all MPs are determined as follows”: 


The UMPD c™P¢ js defined as the marginal price at the intersection of the dispatched marginal 
supply and demand curves f*:“'S (a's) and f%-4is(a4-4is), see Figure 3.3 (a). All dispatched 
bids and offers which are to the right of U umpd the power value at the UMP, also shown 
in Figure 3.3 (a), are priced via pay-as-bid/paid-as-bid. This is necessary, as in real-world 
(congested) networks, dispatching the system, while maximizing the welfare, does not always 
result in a solution, where the total amount of power dispatched is equal to the power value 
at the UMP U™™P?, 


77 The trivial case, in which absolutely no power is traded is left aside here. This would arise if all consumer bids 


are below all producer offers. 
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An example of this case is given in Figure 3.3 (a). Here some bids and offers, those bordering 
the orange shaded area w“', need to be priced by via pay-as-bid/paid-as-bid. A detailed de- 
scription of the reason for this phenomenon is given in Example 3.1 below. Still, this is not 
always necessary; an example that does not need pay-as bid pricing of some bids is provided in 
Figure 3.4 (d). Concerning the definition ofthe UMPD, two special cases are described here: 


1. It is possible that there is not only one point of intersection, as bids of consumers and 
offers of producers may overlap horizontally, see Figure 3.3 (b). Nevertheless, the prices 
c"mpd of all these points are identical. In this case VU", the power value at the UMPD 
is defined as the maximal value of all possible points. 


2. Further, it is possible that f*'8(a*-is) and fdis(24dis) overlap vertically as depicted 
in Figure 3.4 (c). In this case, the UMPD is set to the maximum price of the overlapping 
interval. 


As stated above, when optimizing a CEPDHN respecting the operational constraints, a situ- 
ation may occur where the dispatched power values of @*@i® and m&s are not equal to the 
point UWmPd, where f®™4¢s (gdis) and f4:4'8(a4-4is) intersect. This situation arises depending 
on the network constraints, operational limits, and supply offers and demand bids in the auc- 
tion. This would not occur, by using the “copper plate assumption”, where congestions can not 
emerge, as in the UMPA approach in Section 3.2.3. However, in reality, network constraints 
and the operational constraints of the CEPDHN limit the solution set, as shown in the example 
below: 


Example 3.1: 


A lossless DC EPN with two buses is shown in Figure 3.5. The respective sources and demands 
can vary their power demand or infeed between the stated limits at the costs of the offers and 
bids. The transmission limit is set to 5 p.u.. The result of the social welfare maximization with 
respect to the transmission capacities is shown in Figure 3.3 (c). Thereby, the transmission 
capacity between bus 1 and 2 is lower than the amount of power that could be supplied by 


source S1. 
Source S1 Source S2 
zı € [0 p.u., 20 p.u.] z2 € [0 p.u., 10 pu] 
cı = 1 /p.u. Co = 3 4/p.u. 
Consumer D1 Consumer D2 
z3 € [-l0 pu, 0 pu] v4 € [-20 pu, O p.u.] 
c3 = 2 a/p.u. c4 = 4 4/p.u. 


Figure 3.5: An elementary example of a market clearing based on a congested network with two busses connected 
by a transmission line. 
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Figure 3.3: Different possible pricing constellations (a) and (c) based on submitted and dispatched offers and bids 
of producers and consumers sorted by merit order. Further, the resulting UMPDs and welfare areas are 
shown determined by the optimal dispatch. Note, that the general currency sign © is used here. 
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Figure 3.4: Different possible pricing constellations (b) and (d) based on submitted and dispatched offers and bids 
of producers and consumers sorted by merit order. Further, the resulting UMPDs and welfare areas are 
shown determined by the optimal dispatch. Note, that the general currency sign © is used here. 


3.2 Market Mechanisms 85 


In the underlying optimization of the ISOEMS , the total utility of all MPs in the system is max- 
imized. If that allocation is to the right of the intersection of the supply and demand curves 
as shown in Figure 3.3 (c), the welfare determined by the integral over the orange area w™! 
is subtracted from the integral of the green area 3“ to receive the final overall system wel- 
fare. Since the minimal possible welfare result, based on the optimization is zero, pw > wr, 
and the optimizer will always try to minimize w™f while maximizing 8“'. The pricing for 
all MP bids and offers allocated in w“' is pay-as-bid/paid-as-bid, meaning all consumers pay 
exactly their bid price and all suppliers earn their respective offer price. The difference be- 
tween supply and demand prices is paid by the system operator and transferred to all network 
participants through a grid fee. However, the pay-as-bid/paid-as-bid mechanism encourages 
strategic behavior. A supplier could gain experience over time and try to place its offer in w™! 
and thereby receive higher revenue. Likewise, a consumer could try to set its bid in the same 
space to pay a lower price. This strategic behavior would go against the incentive compatibil- 
ity principle implemented with an AD with uniform marginal pricing. Yet, the predictability 
of RESs is limited and therefore increases the risks resulting from strategic behavior. In a sce- 
nario with incomplete or imperfect information, where all participants have neither all nor 
correct information on all other participants bidding strategies, energy supply or demand and 
the network topology, the incentive for strategic behavior depends on the size of w™f. To 
use the advantage of a UMPA, more precisely, ensuring incentive compatibility to reveal true 
marginal costs of the market participants, the HPA is efficient for small w¥‘ compared to 8“*. 
An advantage of the approach compared to a standard UMPA with uplift costs coming from 
redispatch is, that these costs are directly avoided. This can be understood in the context of 
the Example 3.1 with Figure 3.5. If source S2 and load D2 would submit offers and bids with 
the same prices but rising amounts of power, the uplift costs due to redispatch would rise after 
a standard uniform marginal pricing approach. When applying the HPA presented here, these 
uplift costs are completely avoided. Instead, a grid fee has to be paid by all network partici- 
pants to cover the costs of the negative welfare w™f. As the optimizer inherently minimizes 
w™! this grid fee will stay small no matter how big the offers and bids of source S2 and load 
D2 would become, in the Example 3.1 stated above. Therefore, this approach will lead to a 
better overall system efficiency, if the effects of the lost incentive compatibility and the total 
costs of the grid fee, used to compensate the gap between the bids and offers priced by paid- 
as-bid/pay-as-bid, are smaller than the gains through the omitted uplift costs. It has to be kept 
in mind that full incentive compatibility is also currently not given in the uniform marginal 
pricing-based markets, as bidding parties, for example power plant operators, can be incen- 
tivized to bid for redispatch capacities [STRW 18]. Finally, following remarks are provided for 
additional information and clarity: 


Remark 3.5: 


The consideration of losses and dynamics in network models or ramping constraints is also possi- 
ble. Similar as network congestions both aspects will change the dispatch result but do not limit the 
applicability of the pricing procedure of the HPA introduced above. A detailed discussion on the 
integration of loss bids into the allocation process in order to ensure allocation efficiency is given 
in [MGR* 21]. The main idea is to integrate the losses of the EPN and the DHN as a consumer 
bid into the allocation objective (3.1). This ensures allocation efficiency, as also trade for bids and 
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offers with identical marginal costs, is achieved, which would not be the case, if network losses 
would not be factored during the dispatch procedure. In this matter, the challenge is to determine 
an adequate marginal bid price c° for the loss bids. The closer the defined value of c!°°® is to the 
UMPD as defined in this section above, the less undesired side effects, which will be explained in 
the following, are created. Choosing c° to high will on the one side lead to additional unwanted 
network losses, causing undesired costs. Note, that expenses created through the loss bids are cov- 
ered through grid fees paid by all market participants. On the other side, if ° is set to low, the 
desired market efficiency can not be fully provided. A reasonable choice is to determine c° by the 
UMP as defined in Section 3.2.3, neglecting network constraints. This enables to use the available 
a-priori knowledge based on the submitted bids and offers to estimate the new UMPD calculated 
by taking into account network losses and network constraints. Examples of this procedure are 
given in the Case Study I in Section 4.1. 


Remark 3.6: 


The HPA explained above is performed for every price zone individually after the dispatch, which 
is carried out for the entire CEPDHN at once in a distributed form. Within the approach, the 
EPN and every DHN represents a single price zone. This separation of EPN and DHNs price zones 
is made in order to account for the different bid price levels, as heat is typically a cheaper form of 
energy as electricity [Kon 18, p. 155],[SMA22]. 


Remark 3.7: 


Within the description of the HPA, the pricing is always referred to as a combination of UMPA and 
pay-as-bid/paid-as-bid. Still, some readers might understand HPA much more as a combination 
of zonal pricing and pay-as-bid/paid-as-bid. Even though the HPA is used in multiple price zones, 
the expression zonal pricing will not be used in here for two reasons. First, in contrast to a ZPA the 
price zones are not determined by a priori knowledge on occurring congestions, but as explained 
above in Remark 3.6. Further, the CEPDHN is decomposed into multiple operational zones which 
are controlled by an ISOEMS each. As these zones do not represent the price zones as exemplary 
depicted in Figure 3.6, the term zonal pricing is not used here to describe the HPA in order to 
prevent misleading of the readers. 


Remark 3.8: 


Uniform marginal prices as introduced in Section 3.2.3 can be obtained from the marginal of a 
balance constraint of power demand, power supply and network losses [DF05], thereby neglect- 
ing network constraints. Using this form of determining the UMPDs here would have several 
drawbacks. First, network constraints would not be taken into account. Second, such a model con- 
straint does not align trivially with the CEPDHN model, introduced in Chapter 2, which includes 
dynamic effects as for example pipeline storage. Third, using such a balance constraint within the 
distributed optimization of the ISOEMSs, would necessitate to assign this constraint to one of the 
resulting subproblems of the operational zones. This would lead to a complicating constraint, see 
Definition 3.3, which would need variables from all operational zones, for which the UMP is to 
be calculated. This can create a strong form of coupling among the subproblems which can have 
negative effects on the convergence properties of distributed optimization approaches as explained 
in Section 3.3.2. 
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Operational zone border 


= Price zone border 


Figure 3.6: Exemplary price zones and operational zones in a CEPDHN from Figure 2.1. 


Discussion and Selection 


None of the presented approaches is able to prevent incentives for strategic behavior in real 
world energy markets, especially not in the constrained case, when certain MPs can exploit 
their market power. However, within pure electric energy markets, the LMPA can be seen 
as the most efficient pricing approach for market clearing [MSC03]. Still, the application of 
the LMPA in the TCS for CEPDHNs brings along several problems, that need to be taken 
into account. First, as mentioned earlier in Section 3.2.3, the LMPA is not suitable for DHNs, 
as it is not possible to identify a clear buying and selling price for every FNPs. Second, as 
the TCS is designed as a system of distributed EMSs solving a large optimization problem in 
parallel, methodical aspects of these distributed optimization approaches need to be consid- 
ered. For example, the tuning of parameters in the widely used ADMM approach represents 
a tradeoff between convergence speed and a remaining gap between the dual variables of the 
central solution to the distributed solution, see Section 3.3.2. This is an undesired feature when 
using the LMPA in a TCS as convergence speed and accuracy of the LMPs are both of high 
importance. Third, in order to achieve high technical efficiency, the CEPDHN models become 
strongly nonlinear. In this context, the utilization of soft constraints can help to consider op- 
erational limits within the solution of the optimization problems, also in the case of VMFDs , 
see Section 3.3.1. However, by using a LMPA , these soft constraints would also directly affect 
the LMPs creating unwanted deviations. Besides the LMPA, the difficulty of a ZPA, lies in the 
definition of appropriate zones, for all operation conditions, as outlaid in Section 3.2.3. 


Apart from the methodological aspects mentioned above, it has to be recognized, that this 
work is seen as anchored within the European context, in which a uniform pricing energy 


88 3 Transactive Control System Design 


market clearing is established’*. Hence, the implementation of an approach achieving the 
optimal interaction and coordination of potentially emerging heating markets with the elec- 
tricity markets would presumably be facilitated by adopting similar pricing mechanisms in 
the heating markets. Besides, a pure UMPA leads to additional uplift costs, which can entailed 
high costs, as discussed in Section 3.2.3. This is why, this work is based on the HPA presented 
in the previous Section 3.2.3. Using this approach, incentive compatibility is achieved under 
the conditions mentioned before, and the different price levels in the EPN and the DHNs are 
adequately represented. Summarizing the requirements stemming from the auction design, 
the market clearing procedure, and the HPA, leads to the following statement: 


Assumption 3.3. The EPN and all DHN markets are cleared in a joint, coordinated procedure 
simultaneously, while taking into account physical network constraints during welfare maximiza- 
tion. 


In doing so, additional uplift costs due to redispatch are prevented. 


3.3 Control Mechanisms 


The control mechanisms regarded and chosen within the TCS design process are outlaid in the 
following sections. The basic problem structure of the ISOEMSs and the used class of control 
approach is presented first introducing the necessary terminology. Then Section 3.3.1 explains 
how a central ISOEMS controller can be designed in detail. This is followed by the design of 
the ISOEMSs using a distributed control approach in Section 3.3.2. 


In this work a rolling horizon control mechanism is used as it enables to maximize a gen- 
eral predefined objective, taking system constraints into account, including measurement data 
and predicted INP power demand and supply as well as operational parameters as pump and 
DPR operational set points. Within the TCS for CEPDHNs presented here, the objective is to 
maximize the welfare W, resembling the market allocation objective defined in equation (3.1). 
Whereas, the system constraints are determined by the network models, given in Chapter 2, 
and the operational limits, stated in the following Section 3.3.1. 


78 Within the different price zones. 
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Within the context of control engineering, the ISOEMSs within the TCS represent a nonlinear 
distributed economic time-variant hybrid discrete model predictive control approach for specific 
flow conditions within the DHNs. The terminology is explained as follows: 


e Nonlinear Model Predictive Control (NMPC) : Given a nonlinear optimal control problem, 
following [DFH09, p. 393]: 


: obj/(pst „st 
Be Ye, erat) (3.3a) 
kESk 
subject to 
ai — gto = 0, (3.3b) 
Ce fE (ae zu) =0, Vk ES, k< |S] (3.3c) 
hk (aft, rake Uk) =0, VkeS; (3.3d) 
9, (wi, Zi, Ur) <0, VES, (3.3e) 
with the system state space variables of all time steps a“ = |æẸf, ..., af, ..., °%.], the 
algebraic state variables z** = [zj‘,..., z9',...,2%%,] and the control values given by 
u = [w1,..., Ur, ..., WX] with the cardinality of all time steps on the prediction horizon 


given by n“* = |S,|. Further, the initial system state is defined by #**°. The nonlinear 
discrete dynamic system model is given in equation (3.3c). Together, the equality con- 
straints described with h in equation (3.3d), and the nonlinear discrete dynamic model 
(3.3c) represent forms a Differential Algebraic Equation (DAE) form [DFH09, p. 392f]. 
Additionally, the system boundaries are aggregated in g. Solving the discrete dynamic 
nonlinear optimization problem (3.3) for every time step, in order to find the optimal 
control values u* minimizing the objective q°?4, taking into account latest system state 
measurements 2°" is referred to as MPC [BBM17]. Using the nonlinear system model 
(3.3c) is usually referred to as NMPC [Grü17]. The term discrete stems from the discrete 
system description. 


e Economic: NMPC applications, where the objective g°?) "does not penalize the distance 
to a predefined equilibrium” [Grü17, p. 221], but for example the operation costs of 
systems, are referred to as economic NMPC. 


e Distributed: When multiple NMPCs, each solving a subproblem of (3.3) originating from 
a decomposition of the central problem (3.3) this is described as distributed NMPC. 
Thereby, the individual NMPCs share information during the numeric solution of their 
respective sub problem. The individual sub problems may thereby "be linked by dynam- 
ics, cost functions or constraints” [Grii17, p. 259]. 


e Time-variant: In these systems, the system model f*”® is time dependent, thus written 
as fi}. 


« Hybrid: Here, additionally an event based subsystem is used, which detects the current 
event ev taking place. The system model f%> is then dependent on the current event 
[EFS03, p. 67ff]. 
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For the ISOEMSs in the TCS used for the control of the CEPDHN the following assignment of 
variables to x°*, u, and z** can be made: 


e System states x**: Temperature of water masses in pipelines T“™, originating from the 
entering node temperatures, and SOCs of large TESSs FE, see Remark 3.10. 


¢ Control values u: Power infeed and demand of FNPs in EPN P, and Q, and the DHN ®, 
as well as the operational set points of valves and pumps, K, and ApP™™?P, 


e Algebraic state variables z*': Defined by the rest of all variables. 


In control theory, many control approaches, as NMPC are based on a (nonlinear) state space 
model of the controlled system. In the case of the CEPDHN controlled by the ISOEMS , obtain- 
ing such a regular state space model is not possible, as explained in the following Remark 3.9. 


Remark 3.9: 


Assuming constant mass flows and thus also constant flow directions, a pipeline can be modeled 
as a (damped) dead-time element model, which can be formulated as a discrete dynamic 
state space system model as in (3.3c). However, this will only lead to accurate results, if the 
dead-time tX°@d can be expressed through multiple time step intervals t° = nAk, with 
n € N?®, see [Lun14b, p. 113f], [Lunl4c, p. 441]. Therefore, this would necessitate a very 
small time step interval Ak in order to achieve the demanded accuracy, which would entail 
a large number of optimization variables. Besides, the assumption of constant flow conditions 
is not valid if highly efficient DHN operation is to be achieved, see Section 1.2.5, as aimed 
for in this work. Note, that varying flow velocities” lead to changing dead-times, and there- 
fore to a variation of the system model. Thus, this results in a hybrid system with a hybrid 
time-invariant state space model, where the events are a change of the mass flow within a pipeline. 


Besides the pipelines, large TESSs represent the second CEPDHN components which are rep- 
resented within equation (3.3c). 


Remark 3.10: 


TESSs are distinguished into two groups. The first, are large storages which are owned and op- 
erated by the network operator. As these are directly connected to the DHN *°, meaning that no 
heat exchanger is used to separate the water circulation of the DHN from the storage, they are 
seen as part of the modeled primary network?! and thus their thermal and hydraulic interaction 
with the other network components and their SOC is explicitly taken into account by the model, 
see Section 2.3.3. The losses of these water tanks | are time dependent” , see equation (2.65), and 
thereby an example for the time variance of the system model (3.3c). The second group of TESS are 
owned and operated by FNPs and indirectly connected to the DHN through heat exchangers. For 
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Assuming constant flow direction. 

Assuming sensible hot water storages as defined in Section 2.3.3. 

Water circuit of the main pipelines of the DHN [NTJK20]. All indirectly connected producers and consumers have 
their own secondary networks behind the heat exchanger. In large DHNs secondary networks can also be used 
to distribute heat at lower temperatures as in the primary network to local consumers, then the local network 
participants have their own tertiary networks. 

As they are dependent on the mean temperature of the water within the storage system 
dependent. 


82 Tstor,mean 


which is time 
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these storages, the SOC is not known by the ISOEMS, and thus equation (2.63)® are not taken into 
account. Thus, also no state variables are assigned to these storages. Thus, they are regarded by 
the approach as regular consumers or producers. 


Also, note, that a large TESS is not necessarily found in every Zone assigned to an ISOEMS. 
Further, also other constraints, as ramping constraints introduced later on in Section 3.3.1 
bring along dynamics, which can not be incorporated in (3.3), as (3.3e) is only dependent on a 
single time step. 


Due to the aspects mentioned above, the overall control approach implemented in the TCS is 
referred to as a distributed rolling horizon approach, which is explained in detail in the following 
subsections. For that matter, first the design of a central ISOEMS is presented, which is then 
extended to the distributed case. 


3.3.1 Centralized IIOEMS 


Within this Subsection the rolling horizon approach, used in case of a single ISOEMS control- 
ling the entire CEPDHN is designed. The optimization problem solved within every time step 
k by the ISOEMS can be generalized as the following nonlinear problem: 


min f(x) (3.4a) 

subject to 
h(e) =0, (3.4b) 
g(x) <0 (3.4c) 


Therein, x represents the vector of all optimization variables. Note, that a classification of 
the variables in x into system states a, algebraic state variables z% and control values u 
is left aside from here on, due to the aspects mentioned in Remarks 3.9, and 3.10. Also, this 
helps to facilitate the notation, especially considering the distributed optimization approaches 
presented in Section 3.3.2. The exact objective function f and the operational constraints g, 
used by the ISOEMS, are depicted below in the Objective Function part in Section 3.3.1 and the 
Operational Constraints part in Section 3.3.1. The equality constraints combined in h represent 
the CEPDHN model summarized in (2.105) and introduced in Chapter 2. 


The overall operation procedure of the ISOEMS within the TCS is given in the Nassi- 
Shneidermann diagram in Figure 3.7. 


Two significantly important design parameters are the time step length Ak and the prediction 
horizon, understood as the amount of future time steps taken into account nP = n* = |S;.|. 
It is a commonplace that Ak is to be chosen as small as possible, to achieve high model ac- 
curacy, while nP should be chosen as large as possible, in order to enable foresighted control 
actions. However, both of these incentives tend to enlarge the amount/vector ofthe optimiza- 
tion variables & of (3.4). Thus, a tradeoff between small temporal discretization, length of 
the prediction horizon, and the resulting computation time needed to solve (3.4) needs to be 


83 And consequently also equations (2.64) and (2.65). 
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Initialization of the ISOEMS 


For every time step k 


1. Every EMSSA of an FNP n taking part in the TCS auction mar- 
ket sends its bids/offers c„ to the ISOEMS. Additionally, predic- 
tions of further power infeed and demand of all INPs, as defined 
in Assumption 3.1 above, and operational parameters as e.g. pump 
set points, are sent to the ISOEMS by the network operator. 


2. The ISOEMS calculates the optimal control values for all FNPs, 
and hydraulic devices by solving the NLP problem (3.4) and sends 
these to the respective devices for the upcoming time step. 


3. The ISOEMS calculates the respective price for every bid and ev- 
ery offer, based on the HPA, mainly using uniform marginal pric- 
ing, see Section 3.2.3. These prices are then sent to the FNPs. 


4. All provided measurements from sensors in the CEPDHN are 
used to update variables in x, and parameters in the system model 
h. Typical sensor data available in CEPDHNs comprises measure- 
ments of mass flow, pressure potentials, temperatures, voltages, 
and currents. 

5. The rolling horizon time shift is performed for all variables in x, 
and all parameters in h. The basic rolling horizon procedure for 
all variables in x = [x , -.., Zk, Ek a); replaces £k = p41, 
and sets the newly last time step equal to the previous time step 
Lk n = Lk ox, With nk = |S,|. In contrast to this procedure, 
the rolling horizon time step shift of the thermal pipeline parame- 


nnk ples 


ters Zoekt oko Zune Me,k,c,o and Ke,k,c,o, need a special 
procedure, described in Section 2.3.3. 

6. Based on the previous parameter calculation, the auxiliary 
parameters of the thermal pipeline model ye ko; €c,k,0, RIE os 
Ook oe We,k,c,o, and ter,” can be updated, as stated towards the 
end of Section 2.3.3. 


Figure 3.7: Nassi-Shneidermann diagram of ISOEMS operation procedure including the rolling horizon approach. 
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performed [ZWW* 21]. Through a reasonable choice, this enables to calculate £* the optimal 
solution of (3.4) within Ak during operation. A reasonable choice of the time step length Ak 
is within 5min < Ak < 15min. These ranges are typically applied in Economic Dispatch 
(ED) [Arn11, p. 26] and are thus also a valid choice here. Further, as these time step ranges 
are also applied in intraday markets, as introduced already in Section 3.2.1, it is reasonable to 
use the same time step interval within the market and control mechanisms, thereby enabling 
technical efficiency and economic optimality simultaneously. Possible choices for prediction 
horizons will be discussed within the results in Chapter 4 in detail. 


Objective Function 


Typical flow velocity limits in DHNs are given in the range of 0.8m/s to 3m/s [Glüs5b, p. 
29]. The lower limits are applied to prevent deposits and the overheating of pumps [NTJK20, p. 
124]. In the case of VMFDs it is not possible to implement box constraints, as in the following 
Section 3.3.1 for the mass flows, which would bound the flows away from zero |m] > Ae, with 
Ae > 0. Note, that this would prevent possible flow direction changes, defining these by the 
initial flow directions. 


This can be faced, by introducing soft constraints into the objective function f of the 
ISOEMS in problem (3.4), which incentivizes the solver to find a solution x* in which the 
mass flows are slightly bounded away from zero |m| > As, with Ae > 0. Therefore, the 
objective is put together by the sum of the following two parts: 


f(a) = Fa) + f" (x) (3.5) 


Therein the economic objective f°°°, is defined as the allocation objective, the negative signed 
welfare W stated in equation (3.1), resulting in f°°° = —W. Further, the soft constraints 
are given as f*°''. These soft constraints are implemented by using continuous differentiable 
approximation of of the rectangular function: 


Pe nee) (3.6) 


eesymfd kES% 


with 
Cine) = ui" [1 + sen (wet — (thon) 67) 


The weighting factors w!°¢t define the form of the rectangular function approximation. In 


rect,w rect,h 


doing so, the width of f°“ is enlarged by w,;,’”, while the height is set by w,,,’', as shown 
in Figure 3.8. The used continuously differentiable approximation of the signum function in 
equation (3.7) is given by: 


T 


sgnae(z) = (3.8) 


|r| Ac 
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Figure 3.8: Approximation of the rectangular function, given weighting factors We = 1 and the height 
rect,h _ rect 
Wr = 0.1 of free’. 


while the continuous differentiable approximation of the absolute value function is defined as 
in equation (2.20). 


Remark 3.11: 


Besides the operational benefits, the presented soft constraints f°% also provide a second salient 
feature. Reports on convergence issues of optimization problems, stemming from the considera- 
tion of VMFDs are found in [ZWW* 21] and [Trö99]. Also within the DHN model presented in 
Chapter 2, in some cases, convergence issues were seen, especially when mass flows were near 
zero rn © 0. In this context, using the soft constraints f*°" to slightly bound rn away from zero 
enhances the convergence properties. 
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Operational Constraints 


The specification of operational constraints is given below for the EPN, and the DHN respec- 
tively. These boundaries not only ensure secure and preserving network operation but also 
improve the NLP solver performance [Cor20, p. 319]. The variable bounds ofthe EPN, and the 
FNPs connected to it are: 


ymin < Vik < Var Vi È SP k € Sk (3.9) 
Pee S PaE PERS Vn E SP" k E€ Sk (3.10) 
mE S On S ONE, Vin E SP", k € Sx ae) 


Voltage amplitudes V at buses i are kept within minimum and maximum values, usually de- 
fined in the per unit system. The limits on active and reactive power are defined by relevant 
distribution system transformer capacities, in the EPN , and represent the bid and offer limits 
set by the EMSSAs of the FNPs, and may vary over time. Note, that feeder limits can also be 
readily included in the proposed EPN model. 


The inequalities used to represent the operational DHN, and the connected FNPs, limits are: 


pr" < pix < Ao Vie Sim, k ES (3.12) 
Ap?” < Apek < Ape, Vee St, kesy (3.13) 
mE < hep < MI, Vee St, kes, (3.14) 
Kes Kep < KIY, NEST k ESk (3.15) 
Tin < Tp L TA, Viescm k E Sy (3.16) 
E2? < Epp < B®, Yn ES$, k E Sp (3.17) 
U Nee Daa Vee Sr k E€ Sp (3.18) 
EO ee Des Yn E St k eS; (3.19) 


Pressure potentials p need to be maintained within respective bounds at all nodes ;, since the 
minimum limits p!"!® prevent evaporation and corrosion and maximum limits p!"°* prevent 
damage of the network components. Similarly, this security aspect applies to the differen- 
tial pressures over DHN edges Ap, where the lower bounds also guarantee satisfactory mass 
flow to meet the power demand of consumers. As already mentioned in Section 3.3.1 the 


lower bounds on mass flows 7n™™ prevent the accumulation of deposits and the overheating 


of pumps, while the upper bounds 7n2"** prohibit high pressure losses and thereby lower the 
power necessary for operation of the pumping devices. Note, that for edges e with VMFDs the 
lower bound is defined as min = —rn™*, while soft constraints bound the mass flows away 
from zero, see Remark 3.11. For edges with fixed flow directions, for example due to a check 
valve in the respective string of edges®* mi" > 0, is used to define the flow direction within 
the operation NLP problem (3.4). The valve flow factor limits are used to represent the two 


extreme values of operation; a closed valve for K!""" and an open valve for K2"**. The node 


84 A sequence of edges, where every node only connects two edges of the regarded sequence. 
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Table 3.1: Typical boundaries values of most relevant operational variables in CEPDHNs. 


Variable Minimum Maximum 

Voltage amplitude V; 0.85 p.u. to 0.9 p.u. 1.1 p.u. [MCC+13] 

Nodal pressure p; > peam(T;) + 1.5 bar® < 25 bar® [ZWW 21] 
Mass flow m my un = ymin pw Across aes = ymax gW ATOSS 


ymin — —3,..0.8m/s *” ymax — 3m/s [Glüs5b, p. 
29],[SZP* 09] 
Node temperature T; man (Ere pa) 120°C to 140°C [ZWW* 21, 
NTJK20] 


temperatures T; are limited in the supply network to guarantee satisfactory heat power pro- 
vision to consumers and prevent damage of network components; when applied, limits on the 
return network temperatures enable a high operation efficiency with low losses. The possible 
SOC of a TESS E is limited by the maximal admissible water temperature and the volume of 
the TESS. Minimal outlet temperatures of FNPs Tr can be set, if the prediction horizon is 
insufficient to exhibit, that lower values of ee will lead to nodal temperatures at the last crit- 


ical consumer going below the temperature limits T™i®, necessary for sufficient heat supply. 


Limits on heat power infeed or demand ©" and 6™* originate from the bids and offers of 


the FNPs. 


Remark 3.12: 

In cases, where variables of x appear in the demoninator of a specific model equation, the opera- 
tional limits should be bounded away slightly from zero by setting 2" = Ae, with sufficiently 
small Ae > 0. This applies e.g. for the minimum valve flow factor K™™, see equation (2.31). 


In general, it is not possible to give one set of parameters applicable to every CEPDHN for all 
operation conditions, due to large differences in design and operation form. Still, for the most 
important variable limits of the operational bounds mentioned above, parameter ranges are 
stated in Table 3.1. Ramping constraints can be applied if needed to represent limits in electric 
power injection changes of FNPs®°: 


Pepe AP < Ppp N Vin € SP’, k € Sx (3.20) 
Qn k—1 — AH < Qn,k < Anık-ı + AQP, Yn E Sy", k € Se (3.21) 


The FNP ramping limits are given by AP}?”P for real and AQ:2™P for reactive power. 


85 "This means that at the highest point of the network the pressure of the district heating water must be at least 


0.5 bar higher than the steam pressure at the maximum network temperature [...]. An additional 1 bar is recom- 
mended for any unexpected events."[NTJK20, p. 52] 

"the pressure at maximum load at a specified point and at maximum network temperature"[NTJK20, p. 52]. 
Typical pipeline diameters are in the range of 20 mm to 1000 mm [NTJK20, p. 64]. Also see Remark 3.11 

The maximum value of a value below the freezing temperature Tre°ze and the ambient temperature T?, are 
possible from a technical stand point. Often return network temperatures do not fall below 35°C [ZWW* 21]. 
For kı, the previous time step kı — 1 is equal to the first past time step k}. 
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Similarly ramp limits are applicable for the DHN operation, as?”: 


Ape k-1 — Ap < Ape rn < Ape k-1 + Ape, Vee St keS, (3.22) 
Te k-1 — AMO? < mek < Te k-1 + Amer, Vee Si, k eS, (3.23) 
Te RTOS Te De AT Vices keS, (3.24) 
EN Ba a aA ont, Vees®hkes, (3.25) 
Papi — APEP < Pnp L On pi HAGE, Ynes keS, (3.26) 


Ramping limits on differential pressure Ap??™P or mass flows Am£?”P are used to limit set 
point changes of pumps which help to prevent material fatigue. Similarly, the limits on temper- 
ature differences between time steps APR helps to reduce aging of pipeline insulation, 
see [MMW* 20] or Section 2.99. This can also be applied to the FNPs, where a restriction of 
the variation of the output temperature ATZ?™P-°"t, and the heat power A®!aWP, can be used 
to prevent fast aging of heat exchangers. 


3.3.2 Multiple Distributed ISOEMSs 


There are two main reasons motivating the design of a distributed rolling horizon approach, 
with multiple distributed ISOEMSs, solving the operation NLP problem (3.4), in a coordinated 
form. The first reason is to reduce the computational burden of the potentially large scale 
NLP problem solved for every time step by parallelization [CNP02]. The second is the ability 
to reduce the amount of information sharing between different stakeholders, network opera- 
tion systems and NPs. Note, that as stated in [LGZ*+19]: “for the aim of privacy protection, 
passing some sensitive information such as the system configurations, network data, building 
parameters, and user preferences to the other party is not acceptable” Thus, a TCS designed 
for a CEPDHN reaching over the areas of multiple network operators, could be possibly imple- 
mented more simply if the operational zones of the ISOEMSs were aligned with the network 
boundaries of the different network operators. Apart from Germany, in many regions Distri- 
bution System Operators (DSOs) do not operate EPNs and DHNs but these are operated by 
different institutions [LWM* 18]. 


Remark 3.13: 


Optimal dispatch problems with dynamic models, ranging over multiple time steps, can be de- 
composed into subproblems by two different forms. The first form divides the underlying network 
models into multiple operational zones, thereby applying a spatial decomposition [MDS* 17]. The 
second separates the time steps into multiple sets with consecutive time steps [RMIMD13]. In this 
work, only spatial decompositions are taken into account, as in most sources on distributed optimal 
dispatch of energy systems, see e.g. [MDS* 17]. This is done as it is expected that the dynamics of 
the thermal pipeline model presented in Section 2.3.3, the TESSs model provided in Section 2.3.3, 
and the ramping constraints stated in Section 3.3.1 necessitate more information exchange and 
create more complicating constraints” in the case of a temporal decomposition, as the network 
models in case of spatial decomposition over tie lines and pipelines. Note, that alone the pipeline 


°0 A constraint that is dependant on variables from a different subproblem (here operational zone), see Definition 3.3. 
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model would coupled multiple time steps, for every time step k and every pipeline in the regarded 
DHN, through the mapping of the node temperatures to the positions in the respective pipelines 
and the outlet temperatures, see (2.70) which incorporates (2.66). Additionally, a temporal de- 
composition does not solve the privacy issues stemming from the information sharing between 
different ISOEMSs mentioned before. 


For this spatial form of decomposition, all network elements will be assigned to a specific 
operational zone. Thereby, the following special network elements are defined: 


Definition 3.1 


« Border edge: An edge e crossing the border of two neighboring operational zones, 
e.g. Zone a and Zone b. Note, that thereby this border edge will be defined as a 


border edge in both neighboring operational zones a and b. 
« Border node: A node i connected to a border edge e. 


« Border loop: Border loops are loops l, which have edges e in multiple operational 
zones. 


Before different approaches are presented which can be used to decompose the NLP problem 
(3.4) below, a further entity is defined, which is needed to enable a distributed solution. This 
is the coordinator: 


Definition 3.2 

The coordinator synchronizes calculations and checks if the stopping criterion“ is ful- 
filled for every iteration of the distributed optimization approach [HLW17], applied in the 
design of the ISOEMSs. Note, that in this context synchronizing is understood as starting 


and ending parallel or sequential calculations of the different entities, in the correct order 
and point in time. 


^ Different stopping criteria, are provided in Section 3.3.2, with the respective distributed optimization 
approaches. 


In the following Sections different approaches, which can be used to perform a distributed 
NLP problem optimization are presented and discussed. 


Distributed Optimization Approaches 


Several approaches exist which can be used to solve large scale optimization problems through 
decomposition into smaller subproblems which are then solved in parallel [CCMGB06]. A wide 
number of papers has been published on the application of such techniques to the OPF prob- 
lem, in order to find optimal dispatch solutions of large scale EPNs. In doing so, distributed 
operation is enabled while achieving global optimality [NPC03]. An overview of these ap- 
proaches applied to different forms of the OPF problem is given in [MDS* 17]. 
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OCD and ADMM represent the SOTA and have been successfully applied within the context 
of optimal dispatch of MESs , as will be stated in detail below. Thus, these two approaches and 
further developments of these algorithms will be presented in the following four paragraphs 
on a high level. Thereafter, toward the end of the current section, the aim is to select an 
appropriate distributed optimization approach for the design of the ISOEMSs within the TCS . 
This selection is based on a methodical comparison. 


Alternating Direction Method of Multipliers The ADMM approach brings together the 
Dual Decomposition, the Augmented Lagrangian, and the Method of Multipliers method- 
ologies [MDS*17]. The description of the ADMM algorithm and properties below follow 
[BPCt 11, pp. 13-17]. Given the following problem: 


min f(a) + g(z) (3.27a) 
subject to 


Az +Bz=é (3.27b) 


with optimization variable vectors x and z, objective functions f and g, matrices Aand B, 
and vector č. The Augmented Lagrangian (AL) £?! of problem (3.27) is given by: 


L (æ, z, A) = f(@) + g(z) +" (Aw + Bz — č) + (p"/2)||Ae+ Be (3.28) 


with the AL penalty parameter p?! and the dual variable vector A. The different ADMM iter- 
ations v are defined as: 


Ly 41 := argmin Lpa(£, Zy, Av) (3.29a) 
Zy41 = argmin Lyi (@,41, Z, Av) (3.29b) 
Ave = Ay +p" (Atri + Bzurı — ©) (3.29) 


Supposing, the two following assumptions hold: 


Assumption 3.4. The functions f and g are proper, convex, and closed. 


Assumption 3.5. There exists a saddle point on the (unaugmented) Lagrangian L”. 


Then, the following convergence properties are shown in [BPC* 11]: For v — oo the value of 
f(x) + g(z,) will converge to the optimal objective of (3.27), fulfilling (3.27b). Further, A, 
converges towards the dual optimal vector A*. 


91 With £ = L” for pal = 0. 
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For practical implementations it is of interest to use a stopping criterion, which defines when 
the procedure defined in (3.29) can be ended. This is typically checked by the coordinator as 
described in Definition 3.2. A possible stopping criterion is given in [BPC+11, p. 33]. 


Within the application of an optimal dispatch problem of energy systems with two ISOEMSs, 
one for operational Zone a and one for Zone b. Then, the variables x are optimized during 
the optimization of the ISOEMS in Zone a and similarly, the ISOEMS responsible for Zone b 
optimizes the variables z. Then through (3.27b) a subset of the variables in x and z become 
equal. 


Further properties of the ADMM approach are listed in Table 3.2. Thereby it is important to 
note, that the basic ADMM approach presented here needs a central coordinator performing 
the calculation (3.29c) and the calculations in (3.29) are performed sequentially, first by Zone 
a, then by Zone b and finally by the coordinator. Thus, ADMM in this basic form helps to re- 
duce the problem sizes of the subproblems, but does not enable parallel computation. Further, 
ADMM in this basic form is no fully distributed approach following Definition 1.1, due to the 
calculations of the coordinator. 


Distributed Approaches of the Alternating Direction Method of Multipliers Differ- 
ent approaches exist, to enable a fully distributed and thus parallel calculation of an ADMM im- 
plementation. The main difference to the standard ADMM approach introduced in the last 
paragraph is that the calculation of A is performed by every operational zone in parallel in- 
stead of using a central coordinator. Hence, the role of the coordinator becomes less important 
and the information exchange between the subproblem solving controllers and the coordina- 
tor can be reduced, compare Table 3.2 and Table 3.3. The central basic idea behind these 
approaches, that makes it possible to use ADMM in a distributed form, is presented here for 
the case of two operational zones/subproblems. These are Zone a and Zone b notated by the 
superscripts “za” and “zb” in the following. Supposing subproblems with local variables, here 
x7 and x””, the main idea is to introduce global consensus variables z which will be recal- 
culated based on the average values of all local variables in x = [a”*, x”>], representing the 
consensus variable locally. Assuming a central problem of the following form, considered as 
a General Form Consensus Problem (GFCP) in [BPCt11]: 


min f(x) + f?? (<°) (3.30a) 


subject to 


Ax =z (3.30b) 


with z = |z”, z7], matrices A = diag(A”, A”), and the objective functions of both op- 
erational zones f”* and FEN, Therein, a subset of the local variables in x, is represented in 
both subproblems and thus in «”* and x’. Therefore, as described before for the general 
ADMM approach, also in this case, some variables of the initial central optimization problem 
will be found in both subproblems. 
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Table 3.2: Properties of the ADMM algorithm. 


Property 


Description 


Convergence Speed 


Strongly depends on the choice of p?!. Several 
adaptive algorithms are provided in the literature 
to find appropriate values for different classes of 
ADMM algorithms [MDS*17]. 


Form of Decomposition 
and Coordination in 
MESs 


Over border edges or border nodes of the net- 
work graphs, by duplicating the elements, with 
their respective variables into both adjacent op- 
erational zones. Coordination is then achieved 
through the equality constraint (3.27b) which en- 
forces equality of these border variables, as a sub- 
set of the variables x and z of the two subprob- 
lems. 


Information Exchange 
during runtime 


Zone a sends x to Zone b, Zone b sends z to 
Zone a, both operational zones send their vari- 
ables to the coordinator, coordinator sends A to 
Zone a and b. In this pure form the algorithm is 
not scheduled in parallel. 


Additional role of the co- 
ordinator?” 


Calculation of A in every iteration of the 
ADMM approach. 


Empirical Studies 


An overview of ADMM applied to EPN dispatch 
is given in [MDS*17]. Case studies showing 
the applicability of ADMM to a small scale and 
large-scale CEPDHN optimization are given in 
[LWZS17], however in both test systems the 
ADMM implementation needs at least 2.78 times 
longer to solve the given problem then the central 
solver. A distributed DHN operation based on a 
MILP problem is provided in [KMHG21]. 
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Note, that the general form consensus problem given in (3.30) arises from (3.27), by setting: 


f(a) = f(a) + f(@), gz) =0, B=-I, č=0 (3.31) 
where I defines the identity matrix. 


The distributed ADMM iterations for operational Zone a can then be calculated by: 


ae, := argmin f(a”) + Ra (AU a - 27) + A” = 272 (3.32a) 
oa 
dt sexe 
2 de 5A” a + Aa) (3.32b) 
AA te NE pA py =) (3.32c) 


thereby, it can be seen, that x7, can be directly calculated independently of Zone b. For 
the calculation of 272, , in (3.32b) the newly calculated variables of Zone b er need to be 
communicated. The new values of the dual variables 77, , are then again calculable indepen- 
dently. Note, that the primal and dual variables of Zone b are equally calculated, by replacing 
all “za” entries in (3.32) by “zb” and vice versa”. 


Further, note, that it is possible to limit x and z in (3.30) and thus also in (3.32a) to 77° € 
X7, geb © X, and z € Z. Where, the spaces 17°, Xzb and Z can be defined by (local) 
constraints. This enables to e.g. include nonlinear power flow constraints, when this approach 
is applied to solve distributed optimal dispatch problems, as in [GHT17]. 


Optimality Condition Decomposition The decomposition approach is presented for the 
case of two subproblems/operational zones, marked with the superscripts 7" and *P be- 
low. An exemplary central optimization problem used to illustrate the approach is given as 
[CCMGB06]: 


min, f(x) + f(x?) (3.33a) 

subject to 
h” (°, a") =0, (3.33b) 
h® (x°, x) =O (3.33c) 


with the equality constraints divided into to parts h”* and h””. Then, the Lagrangian is defined 
as: 


N N A”) =fr (g) di Je (x) 
+ Aare) + (AP) h (x°, a”) (3.34) 


92 Therefrom it can be seen, that in the case of two operational zones/subproblems the global variables which are 


of relevance in Zone a and Zone b are the same, as 222 = zz». 
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Table 3.3: Properties of the class of distributed ADMM algorithms. 


Property 


Description 


Convergence Speed 


Strongly depends on the choice of p?!. Several 
adaptive algorithms are provided in the literature 
to find appropriate values for different classes of 
ADMM algorithms [MDS* 17]. The tuning of p”! 
represents a tradeoff between faster convergence 
speed and a remaining gap between the Lagrange 
multipliers of the central solution and those of the 
distributed solution [GHT17]. Further, the con- 
vergence speed is dependent on the chosen de- 
composition [GHT15]. 


Form of Decomposi- 
tion and Coordina- 


Over border edges or border nodes of the net- 
work graphs, by duplicating the elements, with 
their respective variables into both adjacent op- 
erational zones, and by additionally introducing 
global variables x of these duplicated variables 
in z. Coordination is then achieved through the 
equality constraint (3.30b). 


Zone a sends £”? to Zone b, and receives x”? from 
Zone b. If an adaptive penalty parameter updat- 
ing method is used, as e.g. presented in [GHT17], 
then additional communication is necessary for 
every ADMM iteration v. 


tion in MESs 
Information Ex- 
change during 
runtime 

Additional role of the 
coordinator” 


Empirical Studies 


Case studies of this approach applied to the 
OPF problem show, that these approaches can 
lead to convenient results in different test sys- 
tems, including several of the IEEE bench- 
mark networks [MDS* 17, GHT17, Ers14, Ers15, 
MVC17, CKC*14]. Application to MESs are 
given in [XWZ*19, LGZ*19] for a simplified 
DHN model (e.g. assuming constant mass flows) 
and in [YHAt20, XZL*20] without DHN mod- 
els. Demand response in a DHN is shown 
in [CYW20], however, the DHN is not decom- 
posed therefore but ADMM is used to coordinate 
the network dispatch with distributed building 
agents. 


104 3 Transactive Control System Design 


Setting up the Karush-Kuhn-Tucker (KKT) conditions and applying the Newton-Raphson 
method leads to the following set of equations, that is solved for every Newton iteration v 
[Arn11]: 


KKT” KKT®”®] [Ama [Vigea aL (3.35) 
KKT? KKT Acent.zb == Via, a]l . 
—_—_—_—_— > a l m 

KKT Acent VL 


with the differential operator V and the search directions of the central problem given by 
Acent.za — [Azeet za Adcent 74] and Acent.zb er A AN Bl: Further. the KKT 
matrices are defined as [CCMGB06]: 


Viral. (Week) b Va gal (Vazah)" 
KKT” = T eee xz , KKT” ‚za = zb „za x F 
Kea 0 V peo hh 0 
2 sh”) 
KKT” = (KKT); KKT” = ve Ye b ) | (3.36) 


Applying the OCD approach to (3.33) leads to the following two subproblems, for Zone a: 


min ges (x°) Ea A”) T php (2°, z) (3.37a) 
subject to 
h (x°, x”) =0 (3.37b) 
and Zone b: 
min pe (x) J A) Tpz (7°, a”) (3.38a) 
subject to 
h? (T°, x”) =0 (3.38b) 


where the O operator indicates, that these (dual) variables have been turned into parame- 
ters. And all variables and constraints have been assigned to a certain operational zone, while 
the objective function has been split up into two parts. Further (3.37b) and (3.38b) represent 
complicating constraints, which are understood as: 


Definition 3.3 


A complicating constraint is dependent on one or more variables of its proper oper- 


ational zone and one or more variables from one or more further operational zones. All 


variable values coming from different operational zones are then turned into parameters 
by the approach, and are thus treated as constants, updated for every iteration v. 


It has to be noted, that complicating constraints are not only considered within their proper 
operational zone by the approach, but also as soft constraints within the objectives of the oper- 
ational zones, from which the L] parameters originate from, when they are used as constraints, 
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see (3.37) and (3.38). In either case, the used [] parameters are obtained from the (dual) vari- 
ables of the other operational zone from the last Newton iteration v — 1. This indicates the 
basic OCD algorithm for every Newton iteration v: 


1. Perform one Newton iteration of the two subproblems (3.37) and (3.38). 


2. Exchange the information/parameters between the subproblems/operational zones, here 
+ —zb 
Te Te, A and A. 
3. Check if the stopping criterion is fulfilled. If it is not met yet, calculate the next Newton 
iteration v + 1 in step 1. 


Different stopping criteria are stated in the given literature. In [CCMGB06, p. 216f] and [Arn11, 
p. 97] a tolerance € of the (exchanged) optimization variables between two iterations is used, 
while in [CNP02], also the first order optimality measure is compared against a used toler- 
ance. Computing these distributed subproblems with Newtons method is equal to solving the 
following set of equations, within every Newton iteration [Arn11]: 


KKT” 0 Atta] O [Veee (3.39) 
0 KKT” | | Ab Vax, n2>)L i 
eS SS 

KKT Adist 


with the distributed search directions AUst*2 = [Agita AASA] and 

AED AN AND] as well as the approximated KKT matrix KKT. Note that 
by comparing (3.39) with (3.35) it is understood that KKT is obtained from KKT by setting 
the matrices on the secondary diagonals to 0. Now, convergence of the distributed solution 


towards the central solution of (3.33) can be shown if at the provided second-order KKT point 
y* = |x, a>, X”*, AP] the following holds [CNPO2]: 


Assumption 3.6. Lipschitz continuous second-order derivatives of the equations f”*, f, h”, 


and h” exist. 


Assumption 3.7. The Jacobian matrix of the equality constraints of (3.33), precisely 
[(Vh™)", (Vh)T] i provides full row rank. 


Assumption 3.8. For (3.33), the sufficient second-order optimality conditions are fulfilled. 


Further, for every iterate of Newton’s method v, the approximated KKT matrix KKT, has to 
fulfill the condition below: 


Condition 3.1: 


All matrices KKT, of the sequence KKT, — KKT are non singular. 
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Thereby, KKT describes the approximated KKT matrix at the optimal solution. Last but not 
least, the condition for convergence given below needs to hold at y*: 


Condition 3.2: 


pars ‚(7 - (KKT’) KKT") <1, 


with p(L) defining the spectral radius. Further, KKT* represents the KKT matrix at the op- 
timal solution. If Assumptions 3.6 to 3.8 are fulfilled, and Condition 3.1 and 3.2 are fulfilled 
as well, then iteratively solving (3.37) and (3.38) will converge towards y* with at least linear 
rate p°°4-*°> for all starting points y? sufficiently close to y*. The literature often refers to 
p°°t* as the coupling factor. As can be understood from equation (3.40), the coupling fac- 
tor is smaller for decompositions possessing less coupling, thus less non zero entries on the 
secondary diagonals of the KKT block matrix KKT”*”” and KKT’”*. In the context of 
optimal dispatch of energy systems this refers to less tie lines connecting the decoupled oper- 
ational zones [Arn11]. In this sense, a high degree of sparsity of the nodal admittance matrix, 
see Remark 2.2, is a salient property of an EPN, as it increases the probability of finding a very 
appropriate decomposition. 


Further properties of the OCD approach are given in Table 3.4. 


Within the following remarks further important aspects of the OCD approach are described. 


Remark 3.14: 


The OCD approach, which was presented here for the simple case of an optimization problem 
with complicating constraints, can be simply expanded to the case of additional non complicating 
equality and inequality constraints, which only include variables of the respective operational 
zone. Also complicating inequality constraints, as e.g. flow limits over border edges, can be readily 
included in the same manner as complicating equality constraints [NPC03]. 


Remark 3.15: 


There are indications that symmetrically decomposed problems are more likely to fulfill Condi- 
tion 3.2. Symmetrical decomposition means, that a complicating constraint in both operational 
zones is present, which has an identical part and incorporates the same (parameterized) vari- 
ables. The first indication is, that the majority of the published applications of OCD to energy 
system dispatch problems decompose the central problems in a symmetrical form. For example 
in OPF problems, the power flow over a tie line is part of the power flow constraints, see equation 
(2.15), of both border nodes in the two adjacent operational zones. This power flow is dependent on 
the voltage amplitude and phase of the bordering nodes, which are thus part of both complicating 


°3 Note, that it is important to distinguish between the result of the spectral radius of the matrix defined in Condi- 


tion 3.2 p°°¢ and the AL tuning parameter p?! used in the ADMM algorithms. The identical symbols are used here 
to stay in line with the prevailing amount of literature on both approaches. However, distinguishing superscripts 
al and ocd are used for clarification. 

Strictly regarded, this approach decouples the CEPDHN over EPN tie lines, which are connected to energy con- 
verters as EBs and CHPs. 


94 
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Table 3.4: Properties of the OCD algorithm. 


Property Description 


Convergence Speed At least with linear rate p°°%* [CNP02]. 

Form of Decomposi- ‘Typically over border edges of the network 

tion and Coordina- graphs; thereby, the power flow over the border 

tion in MESs edges is defined through potential variables of the 
connected border nodes/buses. 


Information Ex- The operational zones exchange all variables ap- 

change during pearing in the complicating constraints and the 

runtime respective Lagrange multipliers of the complicat- 
ing constraints within every OCD iteration. 

Additional role ofthe - 

coordinator” 

Empirical Studies OCD has been widely tested for optimal dis- 


patch problems for EPNs including several of 
the IEEE benchmark networks [CNP02, NPC03, 
GHT15, GHT16, HGA09]. Further work is stated 
in [MDS*17]. In the context of CEPDHN an ap- 
proach for the decomposition between EPNs and 
DHNs is presented in [HLW17]*4. 


constraints. The second indication is, that in [Ham20] it is shown, that in case of unsymmetrical 
decomposition of a convex optimization problem, certain parameter constellations of the objective 
function do not fulfill Condition 3.2”. 


Remark 3.16: 


Slight model reformulations can have a large impact on the coupling of the operational zones, 
and thus, as well on the coupling factor p°°* but also on the amount of necessary information 
exchange. A simple example demonstrating a reduction of information exchange is given below 
in Example 3.2. Also, see Section 3.3.2 for an example on decrease of coupling, in the context of 
DHN operation. Hence, possible model reformulations should always be checked before decom- 
posing a problem into subproblems for the OCD approach. 


95 Also it appears reasonable, that the distributed search directions Ast will most likely be closer to the central 


search direction A°°" if all operational zones take information of the other (bordering) operational zones into 
account, while calculating Ast. 
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Example 3.2: 


Using the power flow equations of the border buses in the form stated in equations (2.15), 
all bus voltages and phases from Buses ia, 13, and i4 need to be send to the Zone a to apply 
the OCD algorithm. This would entail, that not only bordering operational zones exchange 
information but also operational Zones a and c would have to exchange information. In order 
to prevent this the power flow equation (2.15) of e.g. bus i2 can be defined as: 


Pak= >, Pi, VRES: (3.41) 
jese” 
PHOS, = Vik Via a [BP sin(ði k — diak) + Gis cos(di,r — Sisk )], 
Vi €S”, k € Sz (3.42) 


where the flows between buses is defined as P"'°W. Using this alternative model will prevent 
operational Zone c to communicate information to Zone a, during the solution process. Explic- 


itly in this case, only Zone b will communicate the flows DPI i pfow p and pfow k as well 
2,12, 12,04, 12,13, 
as V;,,x and Îi, k to Zone a. Note, that these considerations can be similarly applied to the 


reactive power flow equation (2.16). 


Figure 3.9: Example showing inadequate modeling can lead to more information exchange. 


In the following Remark 3.17 a possibility to prevent possible singularity ofthe approximated 
KKT matrix KKT is provided. 


Remark 3.17: 


If not all variables occurring in the optimization problem are included in the objective function 
f(a), which is the case in the objective (3.5) this can result in a rank deficiency of the Hessian of 
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the Lagrangian of the central problem Vee The same considerations are valid regarding the 
distributed subproblems of the OCD approach. Thus, also Ne and Veb gL can be rank 
deficient. This entails that the approximated KKT matrix KKT, could become singular for cer- 
tain Newton iterations v, and thus Condition 3.1 would be violated. In this case, the convergence 
of the OCD approach towards the central solution is not be guaranteed. To guard against singu- 
larity in this case, the Hessian of the Lagrangian is slightly modifiable to VŽ a£ + ôI, where 6 
represents a sufficiently small parameter and I the identity matrix [NW06, p. 574]. In doing so, 
the result of the solution is only slightly altered, while singularity of the modified Hessian of the 
Lagrangian Viet + ôI can be prevented. This measure is equivalent to extending the central 
objective f(x) to: 


fre" (æ) = f(a) + f?(a) (3.43) 


where the newly added extension f°(a) is given by f°(a) = ôx! Iæ. Note, that also the new 
central objective f°™ (a) is intuitively decomposed into the objectives of the respective operational 
zones, as f?(x) can be directly decomposed for the subproblems into: 


Pe) = f(a) +f"? (ae) = bar?" Tae + bar" In (3.44) 


Remark 3.18: 

OCD is known to reduce computation time for increasing problem sizes with adequate decompo- 
sitions [CNP02, NPC03, GHT16]. Applied to small optimization problems OCD tends to increase 
the computation time [CNP02, GHT16]. This comes from the fact that OCD usually increases the 
amount of necessary Newton iterations due to the performed approximation of the KKT matrix 
by the approach. Nevertheless, the single iterations are usually performed faster with increasing 
reduction for rising problem sizes. This speed up results for example from the smaller sizes of 
the KKT matrices of the subproblems, which reduces the necessary computation time for matrix 
inversions or the solution of linear systems of equations [CNP02]. 


Optimality Condition Decomposition with Preconditioned Conjugate Gradient 
In case Condition 3.2 is not fulfilled, a Preconditioned Conjugate Gradient Method 
(PCGM) [CNP02] can be applied, to alter the search direction A“'*' in a form that reduces 
its deviation from A®*™*. This can be achieved by modifying equation (3.39) with an appropri- 
ate preconditioner IT as stated below [Arn11]: 


II IKKTA* ew — _IT VL (3.45) 
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Then (3.45) is solved approximately for every iteration of the OCD approach using a General- 
ized Minimal Residual (GMRES) procedure. The central challenge of this approach is to find a 
good preconditioner II [CNP02]. Desired features of II are [Arn11, CNPO2]: 


1. The preconditioner II has to provide full rank, as can be understood from (3.45). 


2. Its matrix inversion should be numerically inexpensive to prevent high additional com- 
putational burden. 


3. Further, it should be of such form, that it is sufficiently close to KKT”, while enabling 
an appropriate transformation so that the newly calculated search direction AU'stn°w 
will be sufficiently close to A", 


Thus, a straightforward choice for the preconditioner is the KKT matrix of the central opti- 
mization problem as II = KKT [Arni1]. However, the main disadvantage of this selection is 
the fact, that the necessity to calculate the inversion KKT, which needs to be done by a cen- 
tral coordinator, will inhibit the desired benefits of the OCD approach, as distributed/parallel 
optimization without the need for a central coordinator. Also the calculation of KKT™ will 
become computationally expensive for large scale problems. Thus, other generally applicable 
preconditioners for nonlinear optimization problems need to be found first, in order to apply 
this approach effectively [CNP02]. Table 3.5 summarizes the rest of the relevant properties of 
this approach. Also note that strictly regarded the special OCD algorithm presented here is 
no fully distributed approach following Definition 1.1, due to the calculations of the coordina- 
tor. 


Comparison and Selection As stated in [MDS*17] for the EPN only case: "Further em- 
pirical work is needed to better characterize the practical performance of distributed opti- 
mization algorithms and the selection of appropriate tuning parameters for various power 
system optimization problems.” As the optimization problem derived in this work, regarding 
the CEPDHN case, with partly new component models, broad empirical studies are not pro- 
vided by current literature, and thus the decision for one of the given approaches is based on 
the methodological properties of the four approaches presented in the four previous sections. 
Therefore, it is assumed, that the assumptions and conditions presented with the respective 
approaches hold. 


The basic ADMM algorithm presented in Section 3.3.2 has several disadvantages over the dis- 
tributed ADMM , as defined in Section 3.3.2. These are, first, the more sequential character of 
the calculation, leaving out options of parallelization. Second, the central coordinator needs 
to calculate the updates of the Lagrange multipliers A in every iteration, leading to additional 
information exchange. 


Similarly OCD with PCGM has the qualitative disadvantages over OCD * to need additional 
calculations by the coordinator, including the inversion of a potentially large matrix, the pre- 
conditioner IT. 


% Choosing II = KKT leads to trivial calculation of AS*:° in (3.45). 

°7 The term additional is used here, to distinguish between the basic role of the coordinator, as synchronizing cal- 
culations and checking the stopping criterion, as defined in Section 3.3.2. 

°8 If OCD itself fulfills Condition 3.2. 
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Table 3.5: Properties of the OCD with PCGM algorithm. 


Property 


Description 


Convergence Speed 


At least with linear rate [CNP02]. 


Form of Decomposi- 
tion and Coordina- 


Typically over border edges of the network 
graphs; thereby, the power flow over the border 


tion in MESs edges is defined through potential variables of the 
connected border nodes/buses. 

Information Ex- The operational zones exchange all variables ap- 

change during pearing in the complicating constraints and the 

runtime respective lagrange multipliers of the complicat- 
ing constraints within every OCD iteration. Ad- 
ditionally, all variables necessary for the precon- 
ditioner calculation are sent to the coordinator, 
which then sends the corrected search directions 
A“'st-° to the individual operational zones. 

Additional role ofthe Check if Condition 3.2 is fulfilled. If this is not the 

coordinator” case, calculation of the preconditioner matrix II. 


Empirical Studies 


OCD with PCGM has been tested for optimal 
dispatch problems for EPNs including several of 
the IEEE benchmark networks [CNP02, NPC03, 
GHT15, GHT16, HGA09]. Further work is stated 
in [MDS* 17]. In [Arn11], this approach is applied 
to the decomposition of EPNs and gas networks 
in MESs. 
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Thus the most promising approaches for the application here are OCD and the distributed 
ADMM approaches. Both algorithms enable mostly parallel calculations and a very low 
amount of information exchange. Still, OCD has two qualitative advantages over ADMM : 


1. The OCD approach does not duplicate variables into the adjacent operational zones, and 
into the global variables, through the form of decomposition. This becomes especially 
relevant when not only a single time step k is optimized but instead several time steps 
|S,| of the moving horizon approach are taken into account. 


2. Further ADMM necessitates the tuning of the AL penalty parameter p*!. Indeed 
the literature states several approaches for adaptive calculation of p°! within every 
ADMM iteration v, but these approaches again build upon the tuning of new param- 
eters [Ers15, GHT17]. The design of these novel coefficients, does not only influence 
the convergence speed, but also possibly distinguishes between convergence (to the lo- 
cal optimum) and divergence [MVC17]. Also it has to be kept in mind, that the tuning 
of p°! represents a tradeoff between convergence speed and a remaining dual gap of the 
marginal values of the central to those of the distributed solution [GHT17]”. 


Further, the necessity of the OCD approach to fulfill Condition 3.2 does not decisively need to 
be understood as a limitation of the approach. As a central question in the design of distributed 
optimal dispatch approaches is always on how the operational zones should be chosen, which 
is closely related to how the decomposition should be performed. This is of high relevance as it 
has direct impact on the convergence speed of the distributed optimization approach [GHT15]. 
Therefore, Condition 3.2 directly serves as an additional quantitative criterion for optimal cell 
dimensioning, as shown in [GHT15, GHT16]. 


Based on the above reasons, the OCD approach will be used in this work to implement the 
distributed ISOEMSs. 


However, so far no literature exists, that has shown the effective application of the OCD ap- 
proach to optimal dispatch problems in DHNs. Thus, a new approach is developed here with 
the aim of bridging that gap, to enable a decomposition of the overall optimal CEPDHNs dis- 
patch problem. 


°° Thus, possibly impeding LMPAs. 


3.3 Control Mechanisms 113 


Distributed ISOEMS Design 


In this Section the design of the distributed ISOEMS is presented. In general it is very sim- 
ilar to the design of the central ISOEMS. The main difference is, that the calculation of the 
optimal control values, based on solving the operational NLP problem (3.4), is performed in 
a distributed form. Note, that this is the second step during run time shown in the Nassi- 
Shneidermann diagram in Figure 3.7. In the distributed case, a coordinator, as introduced 
in Definition 3.2, will synchronize the distributed optimization, performed in parallel by the 
different ISOEMSs. Also the coordinator will end the distributed calculation as soon as a pre- 
defined stopping criterion is fulfilled. 


As discussed in Section 3.3.2, the OCD approach is selected to perform the distributed opti- 
mization within this work. The OCD algorithm has already been used to decompose EPNs into 
different zones, and to divide CEPDHNs into EPNs and DHNs, which are then optimized in a 
parallel form, see Table 3.4. A decomposition of DHNs, has been contributed within this work 
[MIJSH22], and is presented in the following. 


Distributed Optimal Operation of District Heating Networks based on Optimality 
Condition Decomposition The following shows how optimal operation problems for 
DHNs, can be solved in parallel, applying the OCD approach to the central optimization 
problem of an ISOEMS (3.4). Parts of this section have been published in [MIJSH22, pp. 1- 
18]. Note, that (3.4) describes the NLP solved by a central ISOEMS to optimally operate an 
entire CEPDHN. In this Section however, the description is restricted to the case where an 
ISOEMS runs a DHN and thus all parts of the objective function f, the equality constraints h, 
or the inequality constraints g are left aside. When referring to (3.4) within this Section, only 
the parts of the problem which are part of a DHN optimal operation problem are meant. As 
will be shown in this section, applying OCD to DHNs comes along with several difficulties, 
which do not occur when the distributed optimization approach is used to parallelize the solu- 
tion procedure of EPNs. A first difficulty is to find a form of decomposition that leaves enough 
degrees of freedom within the system of equations, of every subproblem. This is demonstrated 
in the introducing Example 3.3. Due to the strong interdependence of flows and pressure drops 
of the symmetric supply and return network, and due to the presence of hydraulic node and 
loop equations, it is non trivial to consider the main hydraulic equations, while finding a form 
of decomposition that leaves enough degrees of freedom. This is a central difference to ap- 
plying OCD to the OPF for optimal dispatch of EPNs, where the subproblems always have 
sufficient degrees of freedom, see Example 3.4. 


Example 3.3: 


We consider the stationary hydraulic model, of the network shown in Figure 3.10, to demon- 
strate the challenge arising from applying OCD to DHNs. A general optimization problem 
(3.46) is assumed here, where the objective of the central problem (3.46a) is represented as the 
sum of the objectives the two subproblems f?* and f””. The equations (3.46b) and (3.46b) rep- 
resent the hydraulic node and loop models which have been introduced in Chapter 2 in (2.23) 
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and (2.24)!%. Besides fPY® in (3.46d) represents the nonlinear relation between mass flow rn 
and differential pressure Ap on an edge e. 


min f + f (3.46a) 
w.r.t. 
XO Aiethe =0, Viest (3.46b) 
eeSdhn 
XO BieApe =0, Vlies (3.46c) 
eesSdhn 
Ape — f°" (te)= 0, Wee Si (3.46d) 


Zone a Zone b 
ay eı 
> + > < 
my 
X X X 
e5 e4 e2 e6 
O y 7 m2 O me 
© Prod 1 O Cons 1 O Cons 2 O Prod 2 
m3 
ig e3 


Figure 3.10: Example DHN decomposed into Zone a and Zone b. 


A straightforward form of decomposition based on OCD can be performed by decoupling be- 
tween node iz and edge e and between node i4 and edge es, as delineated in Figure 3.10. By 
assigning the border loop"! equation of lz to Zone b, the complicating constraints, see Defini- 
tion 3.3, of Zone b are given by: 


my — Me + Mg =0 (3.47) 
Ma — m3 — The =0 (3.48) 
Ap, + Ap + Ap; — Ap, =0 (3.49) 


The value of Ap is determined through equation (3.49). Based on (3.46d) the mass flow Ma 
is also determined in this case, e.g. assuming that Edge e2 represents a valve with a fixed 
valve flow factor K, and the constant component coefficient [42 for Edge ea is obtained from 
aggregation as described in Remark 3.19 below. Also the other variables of edge ee, precisely 
Aps and rng, are known in this scenario through the respective equations in (3.46). Thus, in 
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this instance, the solution of the optimization problem of Zone b has zero degrees of freedom, 
and will in this case by defined by the fixed variable values O obtained from Zone a. In 
this case, the distributed convergence properties will most likely be negatively affected as the 
calculations of Zone b only have a limited effect, providing the new variables x”” and Lagrange 
multipliers A” used in the soft constraints of Zone a, see (3.37a). Intuitively speaking, Zone 
b cannot actively affect the overall search direction of both zones but provide information to 
Zone a, how the search direction calculated by Zone a will affect the objective of Zone b in 
every Newton iteration v. If both zones have zero degree of freedom, see Appendix B for an 
example, the distributed solution of the OCD approach will definitively not equal the solution 
of the central problem (3.46), except for the trivial case, where the problem is initialized at the 
optimal solution. 


In summary, this example shows, that it is not always reasonable to apply OCD, due to a 
lack of degrees of freedom within the system of equations, of the equality constraints of the 
subproblems. However, it is still possible to do so in the aforementioned case, but either the 
convergence speed may reduced if one subproblem has zero degrees of freedom or the solution 
of the OCD approach will be identical to the initial values of the optimization variables xo, if 
both zones have zero degrees of freedom. 


Example 3.4: 


In contrast to DHNs, applying the OCD approach to the optimal dispatch of EPNs cannot 
reduce the degrees of freedom of the subproblems to zero. This can be seen with regard to the 
simple meshed example EPN shown in Figure 3.11. The resulting complicating constraint for 
Bus i, in Zone a results from (2.15) and is given by: 


Pa = Vi Viz Be, sin(d;, E diy) + Gee cos(d;, = bis )] 
g Va Vis Br sin(d;, = Ôi) + GS cos(ð;, = ba )] 
+V Gii (3.50) 


As can be seen from (3.50) also within the complicating constraints the bus voltage amplitude 
and angle, here V;, and 6;, of Bus i, remain variable, including the power flow over e1!”. As 
the same applies to V;, and 6;, in the complicating constraint for Bus ia this shows, that the 
subproblem of Zone a also has sufficient degrees of freedom when applying the OCD approach. 


Zone a Zone b 
il e1 i3 
i2 i4 


Figure 3.11: Example EPN decomposed into Zone a and Zone b. 
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The presented Examples 3.3 and 3.4 demonstrated, that applying OCD to DHNs can simply 
lead to a system of equations of the subproblems with insufficient degrees of freedom, while 
this problem does not arise, when OCD is used for distributed optimization of EPNs. 


Remark 3.19: 


The model equations and the therein used variables of multiple network components can be ag- 
gregated into a single network component to reduce the amount of optimization variables and the 
implementation burden to test new approaches for small DHNs as in Example 3.3, see also [T1120]. 
For example the pressure drop over Edge e; between Nodes i; and iz can be written as: 


Aps = p3 — pı = Bs — ps(7s5)? (3.51) 


where the variable component coefficients Bs and us each represent a sum of the respective compo- 
nent coefficients. Thus for example ps can be written as the sum of the component coefficient of the 
valve BY'’, the pump Be"? and the heat exchanger B&* resulting in Bs = BEY +BEWTP + gexch, 
This is based on the formulas for p and u of different model components in Section 2.3.2. An anal- 
ogous formula can be set up for u5. Note, that taking into account, that the same differential 
pressure Aps can occur for different valve and pump set points, this degree of freedom can be 
used to further aggregate (3.51) into Ap; = p3 — pı = Ps eliminating the degree of freedom. 
Note, that also the thermal component models of heat exchangers, valves, and pumps in edges 
e2, €4, €5, and es can simply be aggregated, as for pumps and valves the output temperature is 
equivalent to the input temperature, see Section 2.3.3. 


Besides, the need to find a form of decomposition that leaves enough degrees of freedom within 
the subproblems, also Condition 3.2 is easily violated when OCD is applied to DHNs. This 
comes from the fact, that decomposing the hydraulic optimization problem (3.46) of a DHN 
as shown in Figure 3.10 into two similarly sized! subproblems directly results in three con- 
straints that represent complicating constraints. Two of these arise from the hydraulic border 
node equations, stemming from (2.23), which are (3.47) and (3.48) in the provided Example 3.3. 
The third complicating constraint originates from the border loop equation, coming from (2.24) 
which is (3.49) in the given Example 3.3. Note, that three complicating constraints of this form 
also arise if one of the other three possible forms of decomposition is used, see Appendix B. 


These special constraints comprehend variables coming from a different subproblem, which 
are thus treated as parameters during the Netwon iterations of the respective subproblem, see 
Definition 3.3. If the central optimization problem is extended to a thermal model, as within 
this application, an additional complicating constraint stems from the thermal node equation 
(2.47)'°4. In general it is known, that a stronger coupling of the subproblems, which is increased 
by every complicating constraint, leads to higher values of p°°%* [Arn11], see the paragraph 
on OCD in Section 3.3.2. Thus, the more complicating constraints exist, the more likely it is, 


103 Note, that a similar size of the subproblems is a desired property as this increases the probability, that both 
subproblems need a similar calculation time for every Newton iteration v. 

Based on the model presented in Chapter 2 the pipeline model equation (2.66) would also have to be taken into 
account as a complicating constraint. However, this can either be prevented by using the elimination of variables 
technique [NW06, p. 426] or through Assumption 3.10, which enables to replace the thermal pipeline model by 
an identity function mapping the input temperature to the output temperature. 


104 
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that Condition 3.2 is not met. In contrast to DHNs, applying OCD to EPNs only leads to a 
single complicating constraint for every border node. 


Also Example 3.3 does not enable a symmetric form of decomposition, which can be advan- 
tageous as described above, see Remark 3.15. This example shows, that the characteristics 
of DHNs, including symmetric return and supply networks, need caution while applying the 
OCD approach in order to enable a symmetric solution, enough degrees of freedom and a low 
form of coupling between the subproblems. 


The approach presented here, to overcome these challenges is based on three key aspects, 
which are outlined here and presented in detail below: 


1. An equivalent reformulation of the optimization problem is used, neglecting redundant 
variables and equations. This helps to reduce the size of the optimization problem and 
the coupling between the zones. 


2. Based on the aforementioned reformulation a different form of decomposition is per- 
formed. Instead of decomposing between network components, as performed in Exam- 
ple 3.3, the decomposition is applied over edges/pipelines, and thus between two nodes. 


3. The central optimization problem is extended, by replacing one equality constraint ob- 
tained from the model reformulation by two new ones. This enables to obtain sym- 
metrical subproblems by applying the decomposition described above. This is desired, 
as symmetrical decompositions potentially lead to better convergence properties as de- 
picted in Remark 3.15. 


In summary these three measures enable to decompose the new central optimization problem 
in a symmetrical form while fulfilling Condition 3.2, as it willbe demonstrated in Section 4.5. 


An exact description of the three aspects is given in the following, starting with the equiva- 
lent reformulation of the optimization problem (3.4) solved by a central ISOEMS as described 
in Section 3.3.1. Therefore, in the following all necessary changes performed, leading to mod- 
eling deviations from the central problem (3.4) are stated. To ease the understanding, these 
model changes and there outplay are described by using the simple DHN shown in Figure 4.22. 
This DHN is very similar to the one shown in Example 3.3, also taking into account the ag- 
gregated model description discussed in Remark 3.19. In order to reduce the coupling of the 
resulting subproblems two measures are performed: First, the hydraulic differential pressures 
Ape over edges e are replace by pressure potentials p; at network nodes i by using (2.22). 


= 

Note, that this relation can be given for the entire DHN as AN p = Ap [MCS20]. Insert- 
T 

ing this into (2.24), written as BAp = 0 for the total network, leads to —B(A“™™ p) = 0 


[Des69]. As Bad! = 0 in all cases, the hydraulic loop equation (2.24) can be neglected 
in the following. Additionally, the hydraulic node equations (2.23) of the border nodes in the 
return network, 73 and i; in Figure 4.22, are omitted. This measure strongly reduces the cou- 
pling of the subproblems, as two complicating constraints of the form (3.54) introduced and 
explained later on, are eliminated. However, by neglecting the hydraulic loop equations and 
the hydraulic border nodes of the return networks the model becomes incomplete, as the rela- 
tion between mass flows and differential pressure of supply and return network on the border 
edges is no more incorporated in the model. This gap is bridged by explicitly introducing the 
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equality Ap; = Aps for Example 3.3 which can be notated as pı — pa = pa — ps or sorted by 
zones as pı + p3 = p4 + p2 into the model. Note, that this also implies mı = ms, based on 
(2.34). In general this can be notated as: 


( > > Billa sx 


dhn,za dhn,be,za ‚ adhn,bi,za 
e€Se se¢Se ieS; 


= ( 5 5 Blatt). 


dhn,zb dhn,be,zb „ dhn,bi,zb 
eesd n,z eg n,be,z iess n,bi,z 


Vlesimbl k E Sp (3.52) 


where the border loops are given in ee and the border edges of Zone a SÄhn.be,2a represent 
a subset of the edges of Zone a given in Sdh"22, and the same notation is used for edges of 
Zone b equivalently. If more then four nodes are found in the regarded border loop J, the 


relevant border nodes are found through |B; .|| A¢2"| = 1 by checking this condition for all 


i,e 
dhn,bi 


border nodes 7 € S; and edges e which are no border edges!” e € SI”, e ¢ Sdhn,be of 
06 


the respective zone’. 


Based on the aforementioned, the second key aspect of the approach, a different form of de- 
composing the central problem, is introduced. This means, the decomposition is applied over 
edges/pipelines and thus between two nodes, as shown in Figure 4.22, instead of decomposing 
between network components as performed in Example 3.3. 


The third key aspect represents the extension of the optimization problem (3.4), by replacing 
the equality constraint (3.52), obtained from the model reformulation, by two new ones. This 
extension is used to enable a symmetrical form of decomposition in the following. Applying 
OCD to (3.46) incorporating the suggested changes stated above, the complicating constraint 
arising from equation (3.52) is assigned either to Zone a or Zone b, thus leading to an unsym- 
metrical decomposition. Also, representing the exact same equation (3.52) twice in the central 
problem would lead to an undesired rank deficiency of the KKT matrix. This can be overcome 
by replacing (3.52) through the following two equations: 


( 5 5 Bella) = pr, 


. ~@dhn,bi,za 
ecS iesp men” 


( > 5 Bella) = pr’, 


dhn,zb dhn,be,zb ‚ -adhn,bi,zb 
eeSe ‚egSe 2 4S; 


dhn,za dhn,be,za 
€ ‚e&Se f 


Vie seen k eS, (3.53) 


A comparison of these equations (3.53) with the initial form (3.52) shows that thereby the 
pressure potentials p; of the nodes in the bordering zone have been replaced by the constant 


BIER dhn,b 
105 All border edges are given ine € SE". 


106 Note, that e.g. the left side of (3.52) can be simplified to I _ .ahn,bi,za Pi,r if only one point of coupling/border 


ies? 
edge (in the return and supply network) to another zone, exists as in Example 3.3. 
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predefined pressure value pP™°. As pP™° is equal in both equations of (3.53), every solution 
fulfilling (3.53), will also satisfy equation (3.52), as (3.53) is a special case of (3.52). The ben- 
efits of this new formulation are that the two equations in (3.53) are naturally assigned to 
their respective zones, without creating further complicating constraints and thus reducing 
the coupling of the subproblems. Additionally, this procedure yields symmetrically decom- 
posed subproblems. A further form which can be used to explain the derivation of (3.53) is 
given in the Appendix in Section C. Besides, the directions of the border edges are slightly 
varied as explained in the following remark. 


Remark 3.20: 


The decomposition only becomes fully symmetrical in the resulting border node equations (3.54), 
(3.59), (3.62), and (3.64) outlayed below, by changing the edge directions of the border edges. As 


shown in Figure 4.22, edge eı is directed away from node i; and ia, leading to Adın = -—-1 
and Adın = —1. Analogously, e3 is directed towards 13 and i4. Visually speaking, every zone 


calculates its solution with its own border edge directions, where the supply network border edge is 
directed away from the border node of the respective zone and the return network edge is directed 
to the proper border node of this zone. This is a deviation from the standard notation of the directed 
graph spanning up the DHN, where every edge is directed away from the start node and towards 
the end node. Still, the resulting system of equations is equivalent, as the differential pressure over 
the border edges Ape is defined using absolute values of Ad”, see (3.56). 


REJ 


The following paragraphs now first introduce and discuss used assumptions, before the com- 
plicating constraints and the objective of the OCD approach are explicitly stated one after the 
other. 


The presented approach is based on the following assumptions, used for simplicity reasons: 


Assumption 3.9. Pipelines with VMFDs are the only component types for which edges can be- 
come border edges. These pipelines are not part of a mesh in the return or supply network. Also, 
no control paths reach across zone borders. 


These assumptions limit the necessity to list possibly resulting complicating constraints for 
different component types. For example pumps, that can be operated in both flow directions, 
would also represent appropriate component models for a decomposition based on the pump 
models, presented in Section 2.31. Besides, pipelines are the most common components in 
DHNs, thus the limitations in finding possible decompositions for this assumption are man- 
ageable. And as discussed after the upcoming assumption, the edges over which the approach 
decomposes the DHN can also be virtual pipelines. 


Assumption 3.10. The pipelines, representing the border edges, are regarded as negligibly short, 
and thus transmission delay, temperature losses, and pressure potential differences due to height 
differences Ah are neglected here, as Ah = 0 is assumed. 


107 Note, that this would imply that a pump is installed in the return and the supply network accordingly. 
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If this assumption would lead to unwanted deviations, due to a non negligible length of the 
pipeline, two artificial nodes and pipelines, one in the return and one in the supply network, 
could be introduced into the model in one of the zones at the end of the current border edge. 
Then, all parameters of the old border edge pipelines are kept the same, and the newly inserted 
pipelines, which are set as the new border edges, have the same parameters except the pipeline 
length L which is chosen as negligently short. 


For simplicity and without loss of generality the approach is presented for the case of two 
zones here. Further, for notational brevity only the optimization problem of Zone a is fully 
stated, while the NLP of Zone b is directly evolvable thereof. All equations except the ones 
replaced above, the complicating constraints and the new objectives stated here, stay the same 
as given in (3.4) for every area. 


The new hydraulic node equation, replacing (2.23) for supply network border nodes in Zone 
a, is given as!®: 


dhn,hydr,sn,bi, y 2 . 
hå ni; ydr,sn,bi,za _ As" rie y + X ) AM e k = 0, 
e€Sdhn eggghn be ec Sahn be 
À dhn,sn,bi 
Vi esp na k E Sk (3.54) 


The main difference here to (2.23) is that border edges e € Sdh"Pe and "normal" edges 
e € Sdhn e ¢ sdhn,be are distinguished. Border edge mass flows can then be expressed in 
dependence of pressure potentials p as stated below. Thereby, taking into account Assump- 
tion 3.10, which entails Ah = 0 and thus 6, ;, = 0 in equation (2.34): 


: Ape, kla 
Mek  SENA: (Apex) Pain 
e,k e,k 
1 Ape,k 


= 5 Ve € Sa k e Sk (3.55) 
V He,k (Mek) V/|Ape,kl Ac 


The dependency of the pressure coefficient on the border edge mass flow ie, k(e x) is elim- 
inated by utilizing a precalculated pressure coefficient u „, based on the border edge mass 
flow of the previous optimization, thus using a similar procedure as effectively applied for the 
thermal pipeline model, recalculating model parameters when applying the rolling horizon, 
see Step 6 of Figure 3.7. Further, the differential pressure Ape x over the considered border 
edge e can be replaced by the difference of the pressure potential of the two connected border 
nodes ;, from which one is in Zone a and the other in Zone b. Thus, the differential pressure 
over the border edge connected to a border node 7 of Zone a can be written as: 


Aper= >> Cale 5 atere) 


Lit dhn 
i Ai,v ESS 


ges 


Veesihnbeza k E Sy (3.56) 


108 The extensive superscripts of h stand for: district heating network, hydraulic, supply network, border node, and 
Zone a. 
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By inserting (3.56) in (3.55) and exchanging the variable u... (e.,r) by the parameter pee , the 
mass flow on the border edge e itself is given as: 


1 Dies hiza Ca ze SirircsmlAP2IPFE) 


ek I 
4 pre 
ern i jesin biza az = Darel) 
Ae 


Vee Saba bem k € Sy (3.57) 


Exemplary, for the network shown in Figure 4.22, equation (3.56) is given by Ap., x = Di, ,k — 
Piz, k for Edge eı in Zone a. Based on this, the border edge mass flow me, k for Zone a stemming 
from equation (3.57) results in: 


1 Piı,k — Piz,k 


ere Ylpas Dis alee 


The thermal node equation, replacing (2.47) for border nodes, is formulated as follows: 


> VkES (3.58) 


Me; ,k N 


dhn,— 2 
| ) Aie max (Mer, 0) 
eesdhn,za „ggdhn,za,be 
dhn,+ $ 
+ ) Aie max ( — Me,r,0) 
eesdhn,za „ggdhn,za,be 


+ 5 A max (rhe k, 0) 


eesdhn,za,be 


pdb therm, biza — 
i,k 


T 5 A max ( — Me,r,0) | Tie 


„egdhn za,be 

dhn,+ . out 

= | ) Aie max (Me,k, 0) Tek 
eeschnza eggghnza,be 


2 > Auer” max ( — tite, O)TE, 


ER 5 (er max (Mer, 0) + Ae max ( — Me,k; o) 


ecgdhnza,be 
> aie dT) =0, 
i Ai, eschn 


Vie simbim nes, (3.59) 
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Note, that similarly as in (3.54) the border mass flows are also defined by (3.57) in (3.59) 
above. With Assumption 3.10, supposing negligibly short pipelines between zones, the thermal 
pipeline model reduces to an identity function mapping the input temperature to the output 
temperature, here T; k = Ty k”. For Node 7; in Zone a in the DHN in Figure 4.22 equation 
(3.59) is written as: 


|max (Me,,k, 0) + max (Me, ,r,0) + max ( — Thes,» 0) | Taz 


= |max ( — Mey.ks oT“ = „k + max (Mes, is OT, + max ( fer: OT =(, 
Vk ESk (3.60) 


The resulting objective function for Zone a f127a, is defined as given below: 


pone = pAhh feste ie X ) | s Gs ‚hydr,sn,bi, Eh dhn,hydr,sn,bi, a 


kESk 


dhn,therm,bi,zb , obj,dhn,therm,bi,zb 
a D (ait hey )| (3.61) 


iggchn,bi,zb 


enden an bi zb 


This objective function fP™7 is composed of two parts. The first describes the decom- 


posed objective of a central ISOEMS f(x) explained in Remark 3.17, which is defined here 
as fihnrest,za for Zone a. Note, that applying the approach described in Remark 3.17 helps 
to guard against singularity of the approximated KKT matrix KKT, while simultaneously 
pursuing the general objective of an ISOEMS, as stated in Section 3.3.1. The second part is 
constituted by the sum of the products of the Lagrange multipliers A and the complicating con- 
straints h coming from Zone b. As indicated by the superscripts the Lagrange multipliers come 


from Zone b of the last OCD iteration from the complicating constraints De and 


ang therm,bi,zb of the respective border nodes. The complicating constraints itself are utilized 


in ine slight modified form given below in (3.62) - (3.64) with the additional obj superscript. 
In comparison to (3.55), (3.57), and (3.59) all variables become OCD parameters and vice versa. 
Also all sets which have been based on Zone a now become dependent on Zone b and the 
other way around. This leads to the following definitions: 


bj,dhn,hyd ‚bi,zb X ) X i 
Re n,hydr,sn,bi,zb __ Aon Tie, ae Ane Wek = = 0, 
e€Sdhn eggdhn.be eggin be 
. dhn,sn,bi, 
Vie Somme k © Sk (3.62) 


109 However, in theory more detailed models as e.g. a static pipeline model similar to (2.71) or a symmetric dynamic 
thermal pipeline model could also be considered in the thermal node equation (3.59). 
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where the border edge mass flow is defined similarly as in (3.57) by: 
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The thermal node equation is formulated as follows for border nodes: 
nebi,dhn,therm,bi,zb — 
i,k = 


| 5 aaae max (Fe) 


dhn,zb dhn,zb,be 
ecse ee 


+ 5 A max ( = Me, ke 0) 


+ 5 A max ( = Me,ks 0) Tik 


cesdhn,zb,be 


dhn,+ AS out 
= | ) Aie max (Te k, 0) TOY 
eesdhn,zb egsdhn,zb,be 
dhn,— TH ii 
+ > Aye” max ( — Mex, O) TIY, 


dhn,zb dhn,zb,b 
EESE egSe 8 


+ > (Ce max (mer, 0) + A max ( — Mek: o) 


eesdhn,zb,be 
dhn dhn = 
> lateaseity.)] =o 
iZi, i escihn 


Vie So k eS (3.64) 


Note, that therein the border mass flows are defined by (3.63). 


In summary, the approach is fully outlined. Simulational results will show the limited range 
of applicability of the presented methodology in Section 4.5. 
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3.4 Summary and Discussion 


The design of a new TCS for CEPDHNs was presented within this chapter. This system is 
based on the coordinated interaction of multiple EMSSAs, each bidding for a single FNP, and 
the ISOEMSs, coordinating the FNPs within their operational zone. For this system, relevant 
market and control mechanisms which are at the core of the TCS have been outlaid and dis- 
cussed in this chapter. The used control mechanism is a distributed rolling horizon approach, 
where the distributed optimization problems are to be solved in every time step based on the 
OCD algorithm. The model-based control approach uses the contributed CEPDHN model pre- 
sented in Chapter 2. The social welfare is used as the allocation objective for electricity and 
heat markets, which are cleared in a coordinated form by the TCS, thereby maximizing the 
welfare of the overall system. Market clearing prices are determined by the HPA, which com- 
bines the uniform marginal price obtained from dispatch? with paid-as-bid and pay-as-bid 
for a fraction of the bids. The exact procedure taking place during transactive control of the 
regarded CEPDHNs is provided in Figure 3.7 for the central case with one ISOEMS. In the 
case of multiple distributed ISOEMSs, the second step is solved by the OCD approach in a 
distributed parallelized form. The TCS is designed to achieve welfare maximization, technical 
efficiency and secure’ CEPDHN operation and forms Contribution 1 of this work. 


In this context, it was shown how important it is to design market and control mechanisms 
in a joint manner, due to their strong interdependence. These interrelations of the mecha- 
nisms can on the one side limit the applicability of certain approaches, and on the other side 
increase the performance of the TCS if adequately employed. Examples for limiting aspects in 
the mechanism designs are the disadvantages arising from the use of the LMPA and ADMM in 
a joint form, or the fact that the LMPA brings along two different LMPs for every FNP in the 
DHN models used within the rolling horizon approach. These show, that designing market 
and control mechanisms independently can have serious consequences, as for example impre- 
cise!!! LMPs or slow convergence [GHT17]. This would entail the inability of the TCS to cal- 
culate new control values in real time. For credit postings, the interconnected design of market 
and control mechanisms greatly play out within the ISOEMSs design. For that matter, the bids 
are provided for the entire prediction horizon, and merged with further data as e.g. predictions 
on power supply and demand. Additionally, network models and operational constraints of the 
CEPDHNs are applied within a (distributed) rolling horizon control approach to maximize the 
welfare of all FNPs. In this sense, allocation and control value determination becomes a single 
procedure. Also, the simultaneous market clearing of the heat and electric energy markets by 
the distributed controllers, the ISOEMSs, enables to enhance the overall welfare. Besides, the 
coordinated design of market and control mechanisms even goes down to far more technical 
aspects. For example, the definition of optimal operation points of pumps and valves has a 
direct impact on the social welfare. In this regard, it is very important to mention, that the 
current literature on comparable approaches usually uses strongly simplified network models, 
as stated in the Research Gap 1 a) and b) in Section 1.2.5. However, when using a model-based 
control approach, it is clear that modeling decisions will directly impact the control values 
and thereby the market outcome. For example predefining the flow direction in the edges of 


110 Defined, as the intersection of the dispatched consumer and producer bid and offer curves. 
111 The lack of accuracy of the LMPs originates from the need of additional iterations, which are very time consuming, 
while the primal variables are already at or near to the exact values in this case, see Table 3.3 and [GHT17]. 
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a DHN model will have a large impact on the obtainable welfare. Similarly, neglecting the 
possibilities of pipeline storage or TESS application will directly impact the obtained welfare. 
Besides the aforementioned, salient technical features of the proposed approach are that the 
rolling horizon approach will always try to minimize temperatures in the DHNs as fast, and 
as far as possible in order to minimize losses and thus maximize the welfare. The collection of 
these examples shows the importance of the joint design of market and control mechanisms 
for CEPDHNs. 


However, achieving welfare maximization, technical efficiency and secure’ CEPDHN opera- 
tion does not only rely on the joint design of market and control mechanisms. Two further 
aspects need to be taken into account here. The first is the fact that the coordinated operation 
of EPNs and DHNs or MES in general leads to a better overall system performance regard- 
ing technical and economic indexes [ZWWt 21, WYJ* 16, LSF14, DLS+19]. The second aspect 
is the ability of the presented TCS to merge all possible information on future power supply 
and demand as well as the respective bid and offer prices, in order to predictively optimally 
dispatch all FNPs connected to the CEPDHNs. 


To the best of the authors knowledge for the distributed rolling horizon approach used in this 
work, which could be classified as a nonlinear distributed economic time-variant hybrid discrete 
model predictive control approach with varying amount of system states, see Section 3.3 no 
methodological concept for the proof of Lyapunov or bounded input bounded output stability 
of the closed-loop case is provided in the literature so far. However, these forms of stability 
are not perused by transactive control approaches in real-world applications. Much more, 
desired system behavior is understood as fulfilling operational constraints in order to enable 
trade, meeting contract commitments of power supply, without causing system damage or 
unnecessary fatigue. 


Note that, the presented TCS enables privacy [KW16] preserving information sharing to the 
FNPs, as only the bids and offers are communicated to the ISOEMS and no further informa- 
tion!!? needs to be shared, see [LLJZ20], [KW16]. Further, considering information sharing, 
the following should be noted. In Germany, today the DSO by itself, operates the electric 
power, gas, water, and district heating systems. For jurisdictions, where there are multiple en- 
tities responsible for utility services of electricity and heat, there has to be information sharing 
agreements between the entities in order to implement the proposed TCS. This will require 
some coordination and policy formation at the regulatory/municipal governmental levels. 


The developed HPA used in the TCS prevents uplift costs due to redispatch. Basing the pricing 
procedure on uniform marginal pricing achieves incentive compatibly if no FNP can take ad- 
vantage of its market power and if no network constraint limits the solution set. The later ne- 
cessitates to price some bids and offers by pay-as-bid or paid-as-bid analogously, as described 
in Section 3.2.3. This leads to a reduction of the overall system welfare. Still, the optimizer 
inherently minimizes the additional costs arising within the HPA, in order to maximize the 
social welfare. This is a central advantage of the HPA in comparison with a standard uniform 
marginal pricing approach, as the only theoretical limitation of possible uplift costs within the 
UMPA arises from the amount and size of the bids and offers provided. Besides these aspects, 
avoiding the necessary command and control actions, to organize the redispatch, arising from 


112 As for example room temperatures, SOCs of battery storages in electrical vehicles or available devices. 


126 3 Transactive Control System Design 


a UMPA [MSC03] enhances the security of the network operation, as unforeseen complicated 
operation conditions are less likely. 


The TCS can enable scalability in large scale CEPDHNs through the utilization of the OCD ap- 
proach, which is reported to reduce calculation times of central optimization problems effec- 
tively for EPNs [NPC03]. Hence, enabling parallel computation of smaller subproblems of 
the large scale nonlinear central operational optimization problem (3.4), as it can be decom- 
posed into subproblems between tie lines of the EPN. Thereby, the conditions stated with the 
OCD approach always need to be fulfilled. This especially applies for the coupling condition. 
As simulation results provided in Section 4.5 will show, so far the contributed OCD approach 
for DHNs does not enable to decompose the overall CEPDHN network graph within DHNs. 
Earlier relevant work in this field using OCD for electricity and gas networks is provided in 
[Arn11]. However, therein the design of appropriate market mechanisms were not regarded. 


The overall operational optimization problem (3.4) which is solved by the central ISOEMS or 
the distributed ISOEMSs in the TCS is a nonlinear non-convex optimization problem. Thus, 
convergence properties can only be evaluated through simulations, as performed in the fol- 
lowing Chapter 4. Still, nonlinear non-convex models and thus optimization problems are 
used in relevant real world applications, due to the absence of reasonable alternatives, as for 
example in the OPF problem [MDS*17] which is strongly related to (3.4). 


Note, that within this chapter it is depicted how the combination of Contributions 2, and 3 
jointly bring up the main Contribution 1 of this work, the TCS for CEPDHNs, see Figure 1.2. 
This is achieved, by outlaying the integration of the detailed CEPDHN model, Contribution 2, 
into the TCS. Further, the HPA for simultaneous market clearing of interconnected DHN and 
EPN markets is described, representing Contribution 3 of this work. Additionally, an approach 
for the distributed optimal dispatch of DHNs, constituting Contribution 4 was developed. 


4 Results 


Simulation results from five CEPDHNs are presented and discussed within this section to show 
and evaluate different functionalities, properties, advantages and limitations of the TCS de- 
signed in Chapter 3. The main topics elaborated in the following case studies and sections 
are ordered in the same form as the approaches are introduced in Chapter 3. Therefore, Case 
Study I will discuss the hybrid pricing approach, Case Study II presents the implementation 
of a centralized ISOEMS, Case Study IH highlights DHN operation with VMFDs and ther- 
mal energy storage systems, Case Study IV investigates calculation times in large real world 
CEPDHNs, and finally Case Study V demonstrates the application of the distributed DHN op- 
timization based on OCD. Parts of this chapter have been published in [MGR* 21], [MTKt 22], 
and [MIJSH22]. 


4.1 Case Study I: Hybrid Pricing Approach 


The application of the HPA is demonstrated within this case study. After a description of the 
regarded CEPDHN and the bids and offers of the FNPs, the results are presented. Note, that 
parts of this Case Study have been initially presented in [MGR* 21, pp. 9-11]. 


4.1.1 Description 


To validate the approach, a version of the case study of the Barry Island from [Liu13, LWJB16] 
is implemented, as displayed in Figure 4.1. Parameters not stated here are given in [Liu13]. The 
used network model consists of 32 DHN nodes and eight EPN buses at 11.5 kV. For simplicity 
and without loss of generality, the underlying radial 0.433 kV power networks are neglected 
and their loads are aggregated into the flexible loads at the Buses I, III, IV, V, and VI. Also, a 
stationary heat propagation model within the pipelines is used. Further, a single time step is 
optimized, see [MGR* 21] for the exact used model. None of the simplifications listed above 
change the functionality of the approach; much more this helps to ease understanding. Bus 
II of the EPN is modeled as the reference bus with fixed voltage angle and magnitude. The 
reactive power consumption of all consumers is modeled by a typical value of cos(p) = 0.95. 
The impedance values of the transmission lines are scaled up in order to show the integration 
of the transmission losses. The bids and offer of all FNPs are listed in Table 4.1. Further, this 
Table also displays the nodes and buses to which an FNP is connected. Hereby, it has to be 
noted, that the cardinality of the network participants is kept low, for simplicity reasons. Still, 
it is assumed that no market participant is able to take advantage of his market power. Prices 
are defined as general monetary units, as they vary strongly in time and different regions 
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depending on developments as regulations, renewable energy sources, fuel prices and CO2- 
certificate prices [Kel13]. 


The COP of the CHP and the HP are modeled with 1.3 and 3.5, see (2.17)*%, as in [Liu13]. It 
is assumed that no MP takes advantage of his potential market power. 


The resulting network topology is displayed in Figure 4.1. 
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Figure 4.1: Modified Barry Island case study [LWJB16]!"%. 


Typical voltage magnitude limits of V™" = 0.9 pu. and V™* = 1.1 p.u. are used. The 
apparent power flows are limited by S™" = 0 p.u. and 9™* = \/5S>8¢ with SPase = 1 kVA, 
as given in [MGR*21]. The reactive power limits Q®™™ = —50 p.u. and Q®?* = 50 p.u. 
are set for the producers. The node temperature limits are defined by Ti" = 40°C and 
Tx = 60°C. Additionally, the consumer and producer mass flow limits are set to min = 
Okg/s and m™** = 5 kg/s. The output temperatures of all heat consumers are assumed to be 
T°" = 30°C, following typical connecting conditions for 4th generation DHNs to assure low 
losses [LSG* 17]. For simplicity reasons, the return network is assumed to be lossless due to 


the low temperature gap of 5°C between the ambient temperature T* = 25°C and the output 


113 For the CHP /HP the exact values are a epn pdhn 1 = 1.3/@,cpn_,dhn | = 3.5 and a, cpn_,dhn m = 0 for all 
ml. 
114 Credit for this Figure goes to Armin Golla. 
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Table 4.1: Relevant parameters of all used network participants. The bid and offer costs are stated in general cost 
units © per unit produced or consumed. 


ne SP" Type es pP™ininp.u. P™?*inp.u. cinv/p. u. 
1 Consumer I -15 0 4.00 
2 Consumer II -15 0 3.70 
3 Consumer II -15 0 3.40 
4 Consumer IV -15 0 3.10 
5 Consumer V -15 0 2.80 
6 Consumer VI -15 0 2.50 
7 Consumer VII -15 0 2.20 
8 Heat pump Vill -15 0 1.90 
9 Power plant I 0 50 2.50 

10 CHP plant II 0 50 1.50 
11 Photovoltaic plant Vil 0 50 1.20 

n esdan Type ie Scn o™™inp.u. Ọ™ə*jinp.u. cin v/p. u. 
1 Consumer 3 -15 0 1.50 
2 Consumer 4 -15 0 1.75 
3 Consumer 6 -15 0 2.00 
4 Consumer 8 -15 0 2.25 
5 Consumer 9 -15 0 2.50 
6 Consumer 10 -15 0 2.75 
7 Consumer 12 -15 0 3.00 
8 Consumer 16 -15 0 3.25 
9 Consumer 17 -15 0 3.50 

10 Consumer 18 -15 0 3.75 
11 Consumer 19 -15 0 4.00 
12 Consumer 20 -15 0 4.25 
13 Consumer 21 -15 0 4.50 
14 Consumer 23 -15 0 4.75 
15 Consumer 24 -15 0 5.00 
16 Consumer 26 -15 0 5.25 
17 Consumer 27 -15 0 5.50 
18 Consumer 29 -15 0 5.75 
19 Consumer 30 -15 0 6.00 
20 Solarthermal plant 1 0 90 2.00 
21 CHP plant 31 0 65.0 3.00 
22 Heat pump 32 0 52.5 1.00 
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temperature of the consumers. The parameter for the approximation of the maximum and 
absolute value function (2.20) is set to Ac = le — 5. The marginal costs of the losses in both 
networks are determined by the UMP , as explained in Remark 3.5. The respective values are 
closs,epn — 2.2 u/p.u. and closs:4h> — 3 o/p.u., see Figure 4.2 and Figure 4.3. 


The case study is implemented in GAMS using the IPOPT solver [NW06]. Thereby, an interior- 
point method is used to solve the resulting nonlinear programming problem. The solution is 
calculated in 1.49 s with an Intel i7-6600U CPU @ 2.60 GHz. 


4.1.2 Results and Analysis 


The aim of this case study is to present the functionality of the approach. The main results 
are found in Figure 4.2 and Figure 4.3. The submitted and dispatched offers and bids of the 
producers and consumers are sorted by merit order and separated for the EPN and the DHN. 
As mentioned in earlier in Remark 3.6, this enables to determine the UMPDs of both networks 
separately, as they represent two different price zones, which is helpful when the price levels 
in the different networks deviate strongly. In the depicted scenario, the UMPD in the EPN is 
cmpd epn — 1.9 o/p.u. while the UMPD in the DHN reaches c¥™P4:4h" — 3 o/p.u.. 
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Figure 4.2: Submitted and dispatched offers and bids of electric producers and consumers sorted by merit order and 
the resulting UMPD for the EPN. 
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Figure 4.3: Submitted and dispatched offers and bids of heat producers and consumers sorted by merit order and the 
resulting UMPD for the DHN. 


Figure 4.2 and 4.3 show that the approach functions as expected. The solution of the opti- 
mization problem shows that the bids of the consumers who are willing to pay the most and 
the offers of the producers which are willing to produce for the lowest prices are dispatched 
both in the heat and the electricity network. The power of the electric power plant, which has 
marginal costs of 2.5 a/p.u., as described in Table 4.1, is additionally dispatched. This does not 
happen if the EPN is optimized on its own. By doing so, parts of the total electric power pro- 
duced by the power plant, the CHP unit and the photovoltaic plant can be used to fully operate 
the heat pump (costs of 1.9 3/p.u.). Based on this, additional welfare is created in the DHN due 
to the high COP of the HP of 3.5, which enables the HP operator to offer low price heat power 
to the DHN consumers. The cost of the respective offer is 1.0 @/p.u., see Table 4.1. The resulting 
uniform price for the EPN c""Pd.epn = 1.9 o/p.u. is defined by the intersection of the marginal 
cost curves of the dispatched supply and demand. The real power losses of the EPN add up 
to Ploss.eP" — 1.5 p.u. and are also depicted in Figure 4.2. Note that these are plotted as part 
of the dispatched solution but obviously not part of the plotted submitted bids, as the losses 
are determined during runtime of the optimization and not known in advance. As the costs of 
network losses are shared by all grid participants through a grid fee, they can be seen as a part 
of the welfare. In this understanding, the costs of the network losses have been added to the 
bids of the consumers in advance. Hereby it is assumed, that producers would directly pass 
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through these grid fee costs to the consumers by raising their offer prices respectively. Then, 
the entire welfare created in the EPN sums up to W°P" = gwf,epn _ wwhepn — 173.03 a, 


The heat losses which add up to ®!°ss.dhn — 10.29 p.u. are priced with c!°°:dhn = 3.0 o/p.u. 
which is equal to the resulting UMPD of the DHN c""Pd,dhn, see Figure 4.3. All heat producers 
are fully dispatched. The consumers with the least priced bids, more exactly heat consumers 
1-6, see Table 4.1, are barely dispatched. Based on this, the welfare of the DHN of wahna — 
486.56 u is created. The total welfare created throughout both networks is equal to W*°' = 
wern + wahr — 659.59 o. 


All network and operational constraints are fulfilled by the solution of the optimization prob- 
lem. Therefore, redispatch becomes unnecessary, as requested. Still, some operational con- 
straints are at the provided bounds, as e.g. the node temperatures of the DHN T;, which vary 
between Tı = 59.99°C and Ty = 40.00°C close and on the bounds defined earlier. 


The case study shows that social welfare maximization is provided while secure® network 
operation can be granted for a real network. Also it demonstrates, that the solution of the op- 
timization problem provides small negative welfare areas w while providing high accumulated 
total welfare W**, close to the potential maximum of the unconstrained network case. 


4.2 Case Study II: Transactive Control System with 
Central ISOEMS 


The performance of the proposed TC approach is studied considering two scenarios, which 
represent diverse functionalities of the presented TCS. These results have been previously pub- 
lished in [MTK* 22]. The first scenario highlights how flexibility is included in CEPDHN op- 
eration by utilizing a BESS, demand side management of consumers in both networks, and the 
heat storage capabilities of the DHN. The second scenario examines how the operation of a 
CEPDHN changes for a very cold winter day with high infeed of RESs, thereby demonstrat- 
ing how the coupled operation improves overall system operation in contrast to independent 
operation of the networks by a TCS, as reported in [LLJZ20]. The application of price signals 
based on the HPA or the LMPA for the EPN and the DHN are also discussed. 


4.2.1 Scenario 1: DHN Flexibility Provision for the EPN 


Description 


Electric Power Network The 11 kV distribution network from the case study in [Liu13] 
is used here as part of the test system, and is shown in Figure 4.4. The EPN comprises ten 
buses and nine radial feeder sections. The flexible consumers, including the heat pumps, are 
located at Buses 2, 3, 4, 5, 7, 8, and 9. The producers and energy converters are chosen to 
clearly illustrate the energy flows in a future energy network. The CHP plant represents a 
flexible producer whereas, the WPP is modeled as an inflexible producer, which aligns with 
the German regulation for maximum infeed of RESs. The distribution grid is assumed to have 
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Figure 4.4: Schematic diagram of the EPN (shown in blue) and the supply network of the DHN (drawn in red color); 
the symmetric DHN return network shown in Figure 4.5 is omitted here for simplicity. 


no power exchange with the transmission system; this is facilitated by placing a BESS at the 
reference bus, which can be considered as a challenging EPN operating condition. The heat 
pumps are modeled as flexible consumers in the EPN and flexible producers in the DHN. 


District Heating Network The DHN supplies all consumers with heat, injected by the 
HPs and the CHP, as shown in Figure 4.5. The FNP at Node 13 is a large-scale consumer 
(e.g. a secondary network) while the other FNPs are small-scale consumers. This DHN has a 
meshed structure due to the presence of the supply and return network; the flow directions are 
determined in advance through the operational states of the pumps and the set point ranges 
of the valves. The effects of check valves in consumer and producer facilities prevent flow 
reversals, which are taken into account in (3.14). The used pipeline model is a special case of 
the model presented in Section 2.3.3, as VMFDs can be neglected, see [MTK* 22] for details. 
The pumps are located next to the producer facilities, i.e., between Nodes 2 and 3, and the 
DPRs are found in the consumer lines, such as the one between Nodes 7 and 8, which en- 
sures that the pressure difference between Nodes 8 and 34 remains constant by varying the 
differential pressure between Nodes 7 and 8. The temperature limits which ensure secure® and 
reliable operation of the supply network are set to 80°C and 130°C, as in [NTJK18], and the 
minimum output temperature of all producers is assumed to be 95°C, for efficiency reasons. 
An ambient temperature of 10°C is considered, as this is a typical autumn temperature in 
Germany. The hydraulic network parameters, such as the roughness, diameters, and lengths 
of the pipelines, are taken from [Liu13]. The hydraulic model variables 3 and p in (2.21) are 
modeled as parameters based initial mass flow values, see [MTK™ 22]. 


Grid Participants The system base power profile and associated peak demands are de- 
fined by assuming that consumers in the power system and DHN are not participating in 
the TCS auction market. It is further assumed that consumers are capable of reducing their 
power consumption up to 30 % at any point in time. This allows to properly demonstrate the 
performance of the proposed framework and the models; in practice, this flexibility would be 
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Figure 4.5: Schematic diagram of the meshed district heating network with supply and return network. 


Table 4.2: Cost and benefit parameters of flexible grid participants in general monetary 
units 5 for Scenario 1. 


ci in a/MW 

BESS 25 

Z CHP 30 
za Heat pump 12 
Flexible Consumer 9 

> CHP 20 
T Heat pump 6 
A Flexible Consumer 7 


determined by their EMSSAs by first calculating the predicted minimum power demand for 
the next hours and the expected usable amount of energy, as outlaid in Section 3.1. The power 
profiles of consumers are based on the electric load profiles of [Gmb18], and the heat load pro- 
files of [YS05a], scaling, time-shifting, and overlaying them with a noise profile to represent 
different consumers. The power profile of the WPP was taken from [Bun19a], and was scaled 
down and shifted. The coupling factor of the CHP was set to 1.42, and the coupling factors of 
the heat pumps were set to 4, based on [NTJK18]. 


The cost and benefit parameters c; of producers and consumers are given in Table 4.2. The 
same values for c; are used here for all time steps k in order to facilitate the analysis of the 
simulation outcome; however, results with varying cost parameters are also tested and dis- 
cussed in [MTK* 22]. It is important to mention that the power injection as well as power 
consumption of the reference bus/BESS results in income for the battery in the form of an 
ancillary service, which can be interpreted as an incentive for storage systems. 
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Figure 4.6: Injected power by all EPN participants for Scenario 1. 


Results and Analysis 


The prediction horizon of the ISOEMS is set to 16 time steps, of 15 min each, which is the 
interval used in the German intraday market, and the total simulation horizon is 24h. Several 
forms can be considered using the proposed approach to provide additional flexibility to the 
power system. In particular and as demonstrated next, one option is to use DSM of electric 
and heat consumers to bridge a period with high power price. This leads to a cost advantage 
for the consumers, allowing to minimize the power injected by more expensive nonrenewable 
energy sources. Another option is the use of HPs during a period of high penetration with 
RESs to transfer energy to the DHN. 


The electric power injected by EPN participants, calculated using the proposed approach, is 
shown in Figure 4.6, where the power injected by consumers is shown in aggregated form. 
A more detailed view of the consumer power is illustrated in Figure 4.7 where the maximum 
and actual aggregated power of all electrical and heat consumers is shown. To understand 
the temporal progression of the electric consumer power, a comparison with the power of 
the reference bus and the WPP of Figure 4.6 is helpful. Thus, during a period with a large 
ratio between the infeed of the WPP and the aggregated demand, the power of the electrical 
consumers is maximized in order to minimize the power transferred by the reference bus; 
this is the case between Oh and 5.25 h as well as between 9.00 h and 16.75 h. The rest of the 
time, the consumed power is reduced to its assumed minimum of 30 % of the maximum power 
demand. This allows minimizing the power injected by the reference bus and the CHP in the 
periods where the injection of the WPP cannot provide the entire power demand. To illustrate 
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Figure 4.7: Aggregated electric and heat power demand of all consumers for Scenario 1. 


the behavior of the HPs the output temperatures at Node 1, 4, and 23, in Figure 4.8 can be used 
in addition to Figure 4.6. In contrast to the consumers, the power of a HP is coupled with the 
output temperature through the temperature ramping constraint (3.25); this causes a strong 
correlation to the current mass flow flowing through the HP, as per (2.59). Thus, during the 
period between 8.75 h and 15.5 h, the HPs consume their maximum power; a further increase 
of the heat power output is not feasible due to the nodal temperature constraints (3.16), as 
depicted in Figure 4.8. During the periods between 7.75 h and 8.75 h and 22.25 h and 23.5 h, 
the power consumption of the HPs is at its minimum. The sharp changes in the temperature 
are due to the varying wind power infeed, as may be noted in Figure 4.6, and the varying 
electric and heat power demand, as shown in Figure 4.7. 


The effective flexibility provision by the DHN can be illustrated in Figure 4.9, where the balance 
between the aggregated power injection and consumption in the DHN can be observed. The 
average node temperature and the power infeed of the WPP is also shown to highlight the 
correlation to the heat power balance. This Figure illustrates the energy that can be stored in 
the DHN; thus, the DHN provides flexibility to the EPN because excess power from it can be 
transferred to the DHN, supplying heat consumers with heat power. In Figure 4.9, it can also 
be observed, that the TCS achieves a very efficient form of DHN operation with low losses, as 
temperatures in the DHN are continually reduced, during periods when low cost power infeed 
of the WPP is sparely available. The described effect is observed from the profile of the WPP 
power infeed and the decreasing average node temperature, with a maximum decline of 30°C, 
between 17.5h and 24h. This is particularly relevant, as reducing the temperatures has the 
largest impact on reducing heat losses in a DHN [CYC04]. 
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Figure 4.9: Power balance and average node temperature in the DHN and injected power ofthe WPP in the EPN for 


Scenario 1. 
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By design, the TCS inherently minimizes the losses in the CEPDHN, which results from two 
important aspects. The first is that the prediction horizon of the underlying NMPC control 
mechanism is limited; thereby, the ISOEMS is continually incentivized to reduce the tempera- 
tures in the DHN to the lower operational limits toward the end of the prediction horizon, in 
order to maximize the welfare in (3.5) by reducing the allocated power infeed into the DHN. 
Therefore, the TCS always uses the stored energy in the DHN pipelines as soon as possi- 
ble, for welfare maximization. The second is the simple fact that lower network losses in the 
entire CEPDHN need less power infeed, which also inherently incentivizes the ISOEMS to 
reduce losses to maximize (3.5). These aspects show how market and control mechanisms of 
the proposed TC approach optimally collaborate to achieve technical efficiency and economic 
optimality. 


The optimization was implemented in GAMS using the IPOPT solver [NW06]. After the ini- 
tialization, each simulated time step, which includes the 16 prediction horizon time steps, took 
less than 2 min 28.97 s of CPU time. The entire simulation of all 96 time steps for this scenario 
took 76min 35.20s on the same hardware as Case Study I, see Section 4.1.1. This enables 
computation in real time even without exploiting the possibilities of distributed parallel opti- 
mization or faster workstations. 


4.2.2 Scenario 2: Price Signals and Independent versus Coupled 
Operation of EPN and DHN 


Description 


The second scenario depicts a cold winter day with an ambient temperature of T, of —10°C. 
The BESS at the reference bus in Figure 4.4 is replaced by a Photovoltaic (PV) plant, and the 
profile of the WPP corresponds to data for the simulated day; both RES profiles where taken 
from [Bun19a] and scaled down to match the demand profiles. Furthermore, RESs are treated 
as all other flexible producers and can thus be curtailed, which results in all auction bids coming 
from fully flexible FNPs, that can reduce their demand and supply by 100 %. Inflexible demand, 
from INPs, is assumed to be allocated in earlier cleared markets or long-term contracts. To 
show the operation for different hydraulic conditions, the operating points of pumps can be set 
variably by the TCS in this scenario. Thereby, the TCS receives additional degrees of freedom. 
Finally, the assumed bid and offer prices are shown in Table 4.3. 


Results and Analysis - Price Signals 


The resulting heat and power injection and demand, are shown in Figure 4.10, where it can 
be seen that HPs are preferred over other flexible electric consumers by the TCS. This is par- 
ticularly obvious between 5.5 h and 8.5 h when the heat demand is large, and the RESs infeed 
is not sufficient to meet the entire electricity demand. Furthermore, note that the TCS utilizes 
HP 3 the most, as it is the highest contributor to the social welfare, while the most expensive 
producer, the CHP, is only run between 5.25 h and 8.5 h to supply the peak demand. 
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Table 4.3: Cost and benefit parameters of FNPs in general monetary 
units a for Scenario 2. 


Ci in a/MW 
CHP 10 
PV 7 
WPP 4 
HP 1 12 
Z HP 2 9 
5 HP 3 9 
Flexible Consumer Bus 3 12 
Flexible Consumer Bus 4 11.5 
Flexible Consumer Bus 8 11 
Flexible Consumer Bus 9 10 
CHP 7 
HP 1 4.2 
HP 2 3.5 
Zz HP 3 3.2 
| Flexible Consumer Node 8 11 
= Flexible Consumer Node 10 10.8 
Flexible Consumer Node 13 10.5 
Flexible Consumer Node 16 10.2 
Flexible Consumer Node 18 10.9 
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Figure 4.10: Injected power by all EPN participants and all DHN consumers for Scenario 2. The power injection of 
the CHP plant and the HPs corresponds to electric power. 
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The LMPs for this scenario are calculated from the optimization model, and the UMPDs are 
based on the HPA, described in Section 3.2.3. The UMPDs of the EPN and the DHN are cal- 
culated separately, based on the intersection of the dispatched offer and bid curves, which 
are established by sorting the dispatched bids and offers by their respective prices, as outlaid 
in Section 3.2.3. The resulting LMPs and UMPDs! are shown in Figure 4.11, respectively. 
Note, that in Figure 4.11 the LMPs show large variations, which may be attributed to some 
extent to the dynamics of temperature propagation throughout the network and the coupling 
component between the EPN and the DHN [DLS* 19]. 


The UMPD of the DHN in Figure 4.12 shows a strong correlation with the heat power demand 
of the DHN, which is a logical result of the power sources accessed by the Merit Order. Also, 
a correlation between the RESs infeed, the total of the WPP and the PV power supply, and the 
UMPD of the EPN can be seen. Thereby, showing lower mean UMPDs towards the mid of the 
day during the time of high power supply, of low price offers of the RESs. A comparison of the 
UMPDs with the marginal bids and offers prices in Table 4.3 yields that the marginal units in 
the EPN price zone are the WPP, the HP 2 and 3, as well as the PV plant. In contrary, all FNPs in 
the DHN except the two consumers at Node 10 and 18, with the highest benefits determine 
the UMPDs at a certain time step. Despite the well known advantages of LMPs in the context 
of market-based EPN operation such a pricing approach does not seem to work in this case 
since two different LMPs are obtained for one FNP, as described in Section 3.2.3. Therefore, the 
UMPD-based pricing seems more appropriate for the application in the presented TCS. This 
pricing approach incentivizes the FNPs to bid with their true marginal costs in the absence of 
network congestions [MGR 21]. 


Results and Analysis - Independent versus Coupled Operation of EPN and DHN 


In order to examine the performance of independent operation of the EPN and the DHN, in 
contrast to their coupled operation, five different operating cases were considered as illustrated 
in Table 4.4. For Case 3 and 4 one network was optimized first, fixing the obtained power 
of the energy converters to optimize the second network sequentially. These resemble the 
operation where either the heat or the electric power market would be cleared first, without 
any information exchange between the markets. In both cases, the optimization of the second 
network failed to converge in several time steps, as noted in Table 4.4. Precisely, for Case 3, the 
DHN optimization problem is terminated by the solver in the first optimization due to the set 
iteration limit at 8000 iterations of the IPOPT solver. The calculation time needed therefore 
is beyond 27 min. However, still multiple constraint violations exist, including the equality 
constraints fixating the heat power infeed of the energy converters to the values obtained 
from the EPN optimization!!®. In Case 4, the EPN optimization fails the first time during the 
optimization performed for the 2 h time step. Thereby the infeasibility occurs at the real power 
flow constraint (2.15) of Bus 2 for the 16 time step, which is the last on the prediction horizon 
and represents the time step at 6h. Note, that this is the time step with the maximum heat 


115 The loss costs are set to 0 »/MW for the EPN and the DHN. 

116 For comparison, running the identical DHN optimization without the equality constraints, fixating the heat power 
infeed of the energy converters to the values obtained from the EPN optimization, leads to conversion within 226 
iterations. 
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Figure 4.11: LMPs of EPN and DHN for Scenario 2. 
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Figure 4.12: UMPDs of EPN and DHN for Scenario 2. 
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Table 4.4: Accumulated 24 h social welfare in various cases. 


Case Social welfare in a 
1. | EPN optimized operation, no DHN 187.39 
2. | DHN optimized operation, no EPN 321.77 
3. | EPN, DHN optimized in sequence No Feasible Solution 
4. | DHN, EPN optimized in sequence No Feasible Solution 
5. | EPN and DHN joint optimization 443.70 
(EPN = 138.06; DHN = 305.65) 


power demand, see Figure 4.10. In this case, the first dispatched heat demand is so high, that 
the resulting EPN load created by the HPs can no longer be provided by the EPN sources. Thus, 
the optimization fails. Thus, a secure® network operation can not be provided in both energy 
networks in either Case 3 or Case 4. 


A comparison of the Cases 1, 2 and 5 for their 24h social welfare, given in Table 4.4, shows 
that the joint optimization of the EPN and DHN yields the highest social welfare, whereas, if 
the EPN or the DHN are optimized independently, without considering the presence of the 
other network, the social welfare is significantly reduced. It should be noted, that the welfare 
obtained from the DHN is larger as the same accumulated from the EPN operation, as the heat 
demand is respectively higher, see Figure 4.101”. 


4.3 Case Study III: DHN Operation with Variable Mass 
Flow Directions and Thermal Energy Storage Systems 


Within this case study optimal market-based DHN operation of the TCS is performed, pre- 
senting the effects of VMFDs and the functioning of a large TESS. 


4.3.1 Description 


The regarded DHN is similar to the network used in Case Study II which is extended here by 
the TESS, including respective edges for the storage valve and pump, see Figure 4.13. The large 
scale TESS is directly connected to the DHN and run by the network operator, as described in 
Remark 3.10. The TESS has a maximum storage capacity of 20 MWh and is initialized almost 
empty, with 0.1 MWh. The losses of the TESS are assumed to be constant with a value of 
l = 1kWh. Further, VMFDs are enabled through adapted valve and pump set point ranges. 
Based on this, variable mass flow directions can occur on the depicted edges, see Figure 4.13. 
The marginal bid and offer prices of all FNPs are given in Table 4.5. Note, that these vary 
over time as stated. The bids and offers of the TESS are set to Cn, = 0 for all time steps k, 
thereby operating it in a way that serves the good of all other market participants. Further, the 


117 The dashed red and blue lines show the maximum heat and power demand. 
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Figure 4.13: DHN with supply and return network with occurring VMFDs and TESS connected. 


factors defining the approximated rectangular function (3.7), used to bounds the mass flows 
away from zero, are set to i = le”? and u = 5e”?. The prediction horizon was 
set to 10 time steps. The optimization of all simulation time steps were calculated within no 


more then 89s. 


4.3.2 Results and Analysis 


The aggregated heat consumption of all consumers and the heat power injection of all pro- 
ducers and the TESS are shown in Figure 4.14. By comparing the power infeed of the different 
producers and the offer costs in Table 4.5 it can be observed that after the initialization the 
aggregated consumed power of all consumers stays fairly constant. Besides the ISOEMS max- 
imizes the welfare by prioritizing the producers offering heat at lower costs. These are HP 3 
and the CHP toward the beginning and the end of the simulation and HP 1 and HP 2 between 
simulation time steps kış and kag. This leads to VMFDs in the DHN which are exemplary dis- 
cussed here for the pipeline on Edge 7, marked as e7 in Figure 4.13. The respective mass flow is 
plotted in Figure 4.15. As HP 3 and the CHP are the cheapest energy sources at the beginning 
and the end of the simulation during these time steps heated water flows from these produc- 
ers over Edge 7 towards the consumer connected at Node 13. In contrast, for ki3 < k < kag 
the flow direction is reversed as the producers on the left side of the DHN provide the main 
power demand. Note, that the storage is strongly charged during the time interval between 
simulation time steps kı2 and k14, when the ISOEMS anticipates, that heat power will be- 
come more expensive in the next time steps, based on the offer prices. Similarly, the storage 
is strongly discharged in the following period until k27 when the offer prices for the upcom- 
ing time steps, sent to the ISOEMS show falling offer prices in the next future. Thereby the 
adapted TESS operation enlarges the overall welfare. 
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Table 4.5: Cost and benefit parameters of FNPs in general monetary units 5 for different simulation time steps k. 


FNP Ci in /MW Ci in a/MW Ci in a/MW 

fork < kig | for kig < k < kez | for k27 < k 
HP 1 12 12 12 
HP 2 13 13 13 
HP 3 10 30 5 
CHP 11 30 T: 
TESS 0 0 0 
Flexible Consumer Node 8 21 21 21 
Flexible Consumer Node 10 22 22 22 
Flexible Consumer Node 13 23 23 23 
Flexible Consumer Node 16 24 24 24 
Flexible Consumer Node 18 25 25 25 


Consumers === HP 1 === HP 2 
--- HP3 === CHP —— TESS 


Heat power injected in MW 


Simulation time step k 


Figure 4.14: Injected power by all DHN participants for multiple simulation time steps. 
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Figure 4.15: Mass flows on Edge 7 for multiple simulation time steps. 
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Figure 4.16: State of charge of the TESS over for multiple simulation time steps and calculated SOCs by the ISOEMS 
over the prediction horizon at these simulation time steps. 
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Figure 4.17: Social welfare obtained in the uniform and VMFDs case for multiple simulation time steps. 


In order to compare the VMFD case with a form of network operation with fixed flow direc- 
tions, the same Scenario was also simulated with fixed (positive) flow directions on all edges, 
except the edges of the TESS between Node 3 and Node 35, see Figure 4.13. The resulting 
social welfare for both cases, with and without VMFDs, is depicted in Figure 4.17. Therefrom 
it can be seen, that after the initialization, the difference in the social welfare increases, with 
increasing offer price deviation between the producers on the left and right side of the DHN. 
As can be seen in Table 4.5 these offer price deviations are maximal between kig < k < kar 
with up to 18 o/MW and remain high with 8 5/MW for the rest of the simulated time steps 
kor < k. This demonstrates, how changing the flow directions in the respective edges, en- 
ables the ISOEMS to provide the consumers with energy from the heat sources with lower 
offer prices. The accumulated social welfare over the regarded 40 simulation time steps adds 
up to 863.5 a in the uniform flow direction case and up to 1042.4 © in the case of VMFDs. This 
shows that using a form of operation enabling VMFDs raises the social welfare by 20.72 % in 
the provided scenario. 
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Figure 4.18: Main network of DHN based on raw data. 


4.4 Case Study IV: Calculation Times in Large Coupled 
Electric Power and District Heating Networks 


The aim of the following case study was to test the calculational burden of the rolling horizon 
approach based on the CEPDHN model of a large scale network. As the computational burden 
of the DHN represents the central challenge, the approach was tested on one of the fifteen 
biggest out of 1169 DHNs in Germany [SS12], the network of the municipal utilities of a city 
in northern Germany. 


4.4.1 Description 
District Heating Network 


The main network of this DHN consists of 2864 nodes and 2894 edges and is shown in Fig- 
ure 4.18. 


In order to reduce the amount of optimization variables for the optimal operation approach 
the network model was aggregated first [BHK*02]. For that matter, serial pipelines are 
merged into a single component, if they are the only components connected to the respec- 
tive DHN node in between. This procedure reduces the network graph to 300 nodes and 367 
edges. Further, possible future producers in the year 2030 were determined based on a design 
problem minimizing operation costs taking into account the fees stemming from CO% emis- 
sions. The results of these calculations proposed the installation of 11 additional HPs with 
4 MW thermal each. The used connection of these HPs to the supply network is indicated in 
Figure 4.19. 
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Figure 4.19: Aggregated supply network of the DHN with connected HPs marked in black. 


The thermal resistance, roughness, length, and diameters of the pipelines were set to typical 
values of 0.3m K/W < Rte < 0.6m K/W, r = 0.01 mm, L = 50 m!"®, and d = 300 mm, 
as given in [NTJK20, p. 64], [Liu13, p. 144]. The amount of positions reserved within a pipeline 
to model water masses 
EBs, HPs, heating plants and a waste incineration plant. The maximal total heat demand is 
around 350 MW. The 100 biggest consumers account for 33 % of the heat demand [MB17]. It 
is assumed, that these largest consumers are used for DSM with the ability to time shift their 


demand by 3h. 


Electric Power Network 


The graph of the 110 kV EPN is shown in Figure 4.20. All assumptions on the present produc- 
ers and consumers”, including values of variable power demand at every bus, are documented 
in [Vie19]. Electric power supply comes from the super ordinate 220 kV network connected 
at Bus 8 and 9, CHPs and a waste incineration plant. The power demand includes the electric 
demand of the EB and the newly installed HPs which are connected at the Buses 1, 2, 4 and 
5. The volume of electric energy sold by the municipal utilities per year is around 733 GWh 
[Sta]. 


118 The set value is understood as a mean value stemming from aggregated pipeline lengths. Therefore, the lengths 
of the new pipelines are calculated by the sum of the aggregated serial pipes [BHK* 02]. 
119 Except the HPs. 
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Figure 4.20: Topology of the 110 kV electric power network [Vie19]. 
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Implementation 


The pre-processing of the raw data was implemented in MATLAB. The optimization problems 
solved for the rolling horizon approach were implemented in GAMS. The used optimization 
problem was slightly altered to fit more into existing network operation forms of network op- 
erators. The parameters defining the soft constraints f5°f within the objective function (3.5), 
bounding the mass flows away from zero, are set to eee = le? and en = oes 
Further, the economic objective f°°° in (3.5) was set to minimize the operation cost of the 
DSO within the network, including resulting costs for the network operator when applying 
DSM. Thus, the idea behind this approach is the design of an EMS for a DSO which is not 
unbundled, in order to minimize its operation costs. Note, that even though the objective 
function is therefore slightly altered, the basic functionality of the approach described in Fig- 
ure 3.7 stays identical, except that the cost parameters needed in f°°° are set and known by the 
DSO and Step 3 is omitted. Thus, also the calculation time needed to solve the optimization 
problem in Step 2, is in a similar range as for a central ISOEMS developed within this work, 
as it uses the same CEPDHN model given in Chapter 2 and operational constraints outlaid in 
Section 3.3.1. 


4.4.2 Results and Analysis 


The obtained calculation times for different prediction horizons are shown in Figure 4.21 for 
three subsequent optimizations on the prediction horizon each. Note, that for a prediction 
horizon of five time steps n°* = |S;| = 5, the solver has returned an error message in the 
first! and second’! optimizations, thus these calculation times are not provided in the graph. 
Here, the solver tries to allocate more memory multiple times before in the first optimization 
before aborting the solution procedure. The results show, that real time capability of the ap- 
proach on standard working stations with of the shelf solvers is not given for large DHNs . 
This is depicted in the 4.21, through the surpassing of the time step interval Ak = 15 min 
used between two optimizations by multiple calculation times of different optimizations. It 
should also be taken into account, that larger prediction horizons are desired to enable the 
energy management system to better anticipate future operation conditions, in order to min- 
imize losses and minimize operation costs, in the application shown within this case study. 
Note, that for a 1h prediction horizon, in certain low flow conditions the supply of the crit- 
ical consumer will not be represented within the DHN model used by the EMS. This shows, 
that larger prediction horizons would be favored. Note, that even though real time capability 
is not reached here, the necessary reduction of computation times seams possible with more 
resources, as necessary reduction factors are assumed to be in the single digit range even 
for larger prediction horizons. Thus in order to enable real time capability, further measures 
need to be taken. These could comprise faster work stations, better initial values x? obtained 
from precalculations with simplified models [Tr699], and the elimination of variables [NW06, 
p. 426]. Besides the aforementioned, using parallelization techniques, as the OCD approach, 


120 TPOPT message: Problem with integer stack size. 
121 TPOPT message: Restoration failed. 
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Figure 4.21: Calculation times needed for different prediction horizons in subsequent optimizations on the rolling 
horizon. 
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Figure 4.22: Regarded DHN with two producers and consumers each decomposed by the orange marked operational 
border into Zone a and Zone b. 


could help to reduce the calculation times. In this context, the basic principle of applying 
OCD to a DHN is demonstrated in the following Case Study V. 


4.5 Case Study V: Optimality Condition Decomposition 
for Operation of District Heating Networks 


Within this case study the applicability range of distributed optimal operation of DHNs based 
on OCD is analyzed. The approach was tested on two DHNs presented below. 


4.5.1 Description 
Four Node Network 


The regarded DHN is shown in Figure 4.22. Note that, this DHN has already been discussed 
extensively in Section 3.3.2, where the approach has been presented. The case study was 
implemented using the aggregated component model form described in Remark 3.19. In doing 
so, the network can be described with only four network nodes i and six network edges e. As 
explained in Remark 3.20 the border edge directions are set to direct away from the border 
nodes 7 in the supply network and towards both border nodes in the return network, within 
the regarded DHN node edge incidence matrix A“. The optimization is initialized with a flat 
start, thus setting x = 0. Mass flows have been limited to 0 kg/s < m. < 2 kg/s, permissible 
outlet, inlet and nodal temperatures are defined as 70°C < T < 100°C. The box constraints 
of the injected power infeed of the producers on Edges es and e, are OkW < ® < 40kW, 
while consumers on Edges e2 and e; are limited to —40kW < ® < OkW. The predefined 
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pressure coefficient ju)"; of the pipelines was set to 1 and the predefined pressure value pP"° 


used in (3.53) was set to 0.2. The marginal bid prices cn of the FNPs nı, na, ng, and n4 on 
Edges e;, €4, ea and e are set to 1, 10, 20, and 20. Note, that nı and n4 are producers while 
na and ng are consumers, as can be seen from Figure 4.22. The approach to guard against 
singularity of the approximated KKT matrix was used, as explained in Remark 3.17, with the 
parameter ô = le~®. 


Eight Node Network 


A second network was tested, which represents an extension of the Four Node Network de- 
scribed in the previous Section. In this network a pipeline is added before and after the two 
producers shown in Figure 4.22. In order to connect these newly inserted pipelines with the 
producers, also a node is added between each pipeline and every producer. Thus, in total the 
network shown in Figure 4.22 is extended by four pipes and four nodes. The entire set of 
parameters used is provided in [MIJSH22]. 


4.5.2 Results and Analysis 
Four Node Network 


The results obtained from the approach presented in Section 3.3.2 for two ISOEMSs is com- 
pared here against the results obtained from a single central ISOEMS. The solution of the cen- 
tral ISOEMS case is shown in dashed lines within the plots of Figure 4.23. As can be observed 
from these graphs the mass flows, the nodal pressures, the node temperatures and the power 
infeed or demand of the FNPs converges to the same values for the distributed ISOEMS case!””. 
The maximum deviation of the plotted values between the central and the distributed solu- 
tion is obtained for the node temperature at Node ig with —0.157 mK. The central solution, 
implemented in GAMS with the IPOPT solver needs 29 iterations to converge to the standard 
solver tolerances, while the distributed approach achieves this accuracy after 100 iterations. 
This need for more iterations is expected, as the search direction is calculated less accurate 
in the distributed case as in the central implementation, which leads to a need of additional 
iterations. This finding accords with the results in [CNP02, NPC03]. As the calculation times 
of the single iterations could be reduced in the distributed case, for lager networks and thus 
optimization problems, the distributed case may reduce the calculation times as demonstrated 
in [CNP02] for EPNs, also see Remark 3.18. The primal infeasibility!” ||h(a)||,. of the sub- 
problems per iteration v is shown in Figure 4.24 on a logarithmic scale. Therefrom it can be 
seen, that both subproblems fulfill the set constraints with a maximum constraint violation 
below 1.1e~* after 100 iterations. Note, that similar results were also obtained for different 
sets of parameters within this network, see [MIJSH22]. 


122 Note, that the mass flows of Edge 1 and 2 are nearly the same mı ~ ma, as the flow through Edge 7 is me = 0, 
also Ty ~ To, thus these values are hard to distinguish. 
123 Based on the IPOPT NLP problem formulation [Wäc09, p. 7]. 
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Figure 4.23: Four most relevant variables plotted for the performed OCD iterations. The dashed lines show the 
solution of the central optimization. 
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Figure 4.24: Primal infeasibility for current iteration v. Note, that the infeasibility is not plotted if it drops below 
1074. 


Eight Node Network 


The Eight Node Network did not show the expected convergence properties, see [MIJSH22]. 
In contrast to the Four Node Network, where convergence of the distributed solution was seen 
for a majority of the tested parameter sets, in the regarded Eight Node Network only a minority 
of the regarded parameter sets showed a convergence of the OCD approach toward the central 
solution. A potential explanation for this result is that in the Eight Node Network case, which 
in contrast to the Four Node Network includes the thermal pipeline models, Condition 3.2 
might be regularly violated. 


156 4 Results 


4.6 Summary and Discussion 


This section summarizes and discusses the main findings ofthe performed simulations, demon- 
strating the applicability and limitations of the proposed TCS for CEPDHNs. 


The application of the HPA in Case Study I showed how the uniform marginal prices obtained 
from the dispatch solution are calculated for a CEPDHN. Case Study II and III show how 
the ISOEMS fully utilizes the different flexibilities of the CEPDHN in a predictive manner, to 
maximize the welfare and thereby minimizing curtailment of RESs, and the losses occurring 
in the CEPDHN. The used flexibility originates from storage systems, thermal inertia of the 
DHN pipeline, as well as from demand side management of consumers in the EPN and the 
DHNs. Also, comparisons of the coordinated operation of the EPN with the DHN with a sepa- 
rated form of dispatch show the superiority of the coupled operation. Further, different price 
signals have been provided obtained from the TCS operation. The results of Case Study IV 
highlight that the proposed transactive control approach for CEPDHNs can also be used for 
further applications as operation cost minimization of a network operator by adapting the 
objective of the ISOEMS and the information exchange between the engaged entities. Fur- 
ther, these simulations show, that for large CEPDHNs, the approach, based on the detailed 
CEPDHN model presented in Chapter 2 leads to a high computational burden. This limits the 
real time capability of a central ISOEMS on a standard work station with of the shelf solvers. 
Case Study V demonstrated the application of the distributed rolling horizon approach based 
on OCD. The results showed expected convergence properties for a majority of the tested 
parameter sets for a small example DHN but the distributed solution does not converge to- 
ward the central results for the second tested Eight Node Network. In summary, these results 
presented different aspects of the CEPDHN operation performed by the TCS. 


The application of the HPA in Case Study I showed the effectiveness of this pricing approach, 
in case that no market participant is able to exploit his market power. However in the case 
of large market power of single market participants further measures as regulation or grid 
reinforcements would be necessary to limit profits of respective actors. 


The comparisons performed in Case Study II between the coordinated operation of the 
EPN and the DHN with a separated form of dispatch shows the superiority of the coupled op- 
eration, which is in line with the state of the art [ZWW* 21, WYJ* 16, LSF14]. Similar results 
provided in the literature showing the benefits of joint operation of CEPDHNs with flexible 
demand enhancing social welfare up to 16.6 % are provided in [SDWS17]. Also simulational 
results in [LWW 19] show that an optimal joint operation of CEPDHNs leads to a 17.19% 
RESs curtailment reduction. Note, that the superiority of joint CEPDHN operation not only 
stems from higher overall welfare but also from the absence of insecure network operation 
conditions’. This can be seen from the simulations provided in Case Study II, where a naive 
sequential dispatch of the EPN and the DHN led to failure of convergence of the optimiza- 
tion. 


The simulational results provided in Case Study III show how important it is to take 
VMFDs into account when dispatching DHNs. Precisely, enabling VMFDs in the regarded 
scenario raises the accumulated social welfare by 20.72 %, as this allows to supply consumers 
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with the lowest priced offers. To the best of the authors knowledge this aspect has so far not 
been sufficiently researched in the context of market-based DHN operation. 


The findings from Case Study IV, demonstrating the high computational burden of the high 
detail DHN model, surpassing the 15 min time step intervalls for small prediction horizons 
below 6 time steps, align with statements on computational effort from [ZWW*21]. In this 
context, the interest in possibilities to speed up computations by parallelization techniques is 
straightforward. Regarding the results of the proposed OCD approach for DHNs, the increase 
in iterations v needed to obtain the distributed solution compared to the central solution for the 
Four Node Network is in line with findings from [CNP02, NPC03]. These sources show, that the 
amount of iterations needed by the OCD approach are typically larger, as the search direction 
is calculated in an approximated form. Still, the single iterations will take less computation 
time for large scale problems, which is the basis for the calculational time reduction obtained 
from OCD. However, the limited convergence properties of the larger DHN solved by OCD in 
Case Study V showed, that the approach cannot be applied to general DHNs, in its current 
form. 


Based on the aforementioned, the scalability of the overall TCS approach is clearly limited to 
DHNs with medium size, within the CEPDHNs,, as the DHN optimization model comes along 
with a high computational burden. Based on the calculation times obtained from Case Study 
II and IV the possible maximum DHN size lies between 39 and 300 nodes on a standard work 
station with of the shelf solvers. On the other hand, the approach is expected to scale over 
large EPNs as calculation time reduction by distributed parallel optimization of EPNs based 
on OCD has been reported by multiple sources [NPC03, GHT16]. Thereby, it is important that 
the coupling condition has to be fulfilled for the respective decompositions. 


All in all, the presented simulation results show the applicability of the presented TCS, to 
operate CEPDHNs in a technical secure® and efficient as well as welfare maximizing form. 


5 Conclusion 


The need for a carbon dioxide free and at the same time affordable energy supply creates a 
demand for new forms of network operation in EPNs and DHNs. As motivated in Chapter 1 
desired properties of future CEPDHN operation approaches are the ability to coordinate a 
vast number of flexible network participants while achieving technical efficiency, economic 
optimality and secure® network operation. For that aim, existing economic and technical inef- 
ficiencies are to be reduced by designing market and control mechanisms in a joint form and 
by operating the physically coupled EPNs and DHNs in a coordinated form. Therefore, the 
objective and central contribution of this thesis are the design of a transactive control system 
for CEPDHNs. The TCS was designed with two hierarchy levels, comprising the EMSSAs on 
the first level and the ISOEMSs on the second level. Every EMSSA, representing an FNP, sends 
its bids or offers to the ISOEMS of its proper operational zone. As no further information be- 
sides the bids or offers is shared by the EMSSAs the approach enables a high level of privacy 
[KW16], while enabling end user participation [LLJZ20]. The ISOEMSs also obtain further 
power demand and supply forecasts and operational values as e.g. pump operation set points 
of their operational zone. Using all the provided information together with the contributed 
detailed CEPDHN model and the given operational limits, the ISOEMSs determine the opti- 
mal control values for the CEPDHNs. Thereby, the ISOEMSs achieve economic optimality by 
maximizing the social welfare, technical efficiency through the detailed CEPDHN model and 
secure® network operation by taking into account the operational limits. The overall approach 
represents a distributed rolling horizon procedure. 


In contrast to the state of the art, the detailed network model considers all relevant physical 
effects of CEPDHN operation. These are variable mass flows with VMFDs, an exact repre- 
sentation of the pipeline friction factors, storage effects of pipelines, DPRs, pumps, and their 
respective control paths, thermal energy storage systems and lossy meshed AC EPNs. The 
comparatively high modeling detail of the presented CEPDHN model brings along two im- 
portant features. First, it enables a technically efficient form of CEPDHN operation with low 
losses. Second, this modeling is the basis for enabling welfare maximization. In summary, the 
detailed CEPDHN model forms Contribution 2 of this work, bridging the Research Gap 1 a) b) 
stated in Section 1.2.5, see Figure 5.1. 


As demonstrated in the results in Chapter 4, the detailed CEPDHN model brings along a high 
computational burden. Therefore, counteractive measures are taken in order to reduce the 
necessary computation times. First, the thermal pipeline models within the CEPDHN model 
are directly embedded into the rolling horizon approach. This is achieved by using precalcu- 
lated mass flow parameters in the thermal pipeline model which avoid the need for integer 
variables, which would necessitate to solve a badly scaling MINLP problem at runtime. The 
presented approach precalculates the mass flow parameters after every optimization follow- 
ing the rolling horizon implementation, as explained in Section 3.3.1. Second, a distributed 
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Figure 5.1: Relation between research gaps and contributions of this work. 


rolling horizon approach is utilized which enables to parallelize the computations by multiple 
ISOEMSs. Therefore, different distributed optimization approaches have been compared. The 
optimality condition decomposition approach was selected due to the low amount of neces- 
sary information exchange between the ISOEMSs, the absence of tuning parameters, and its 
successful application within distributed optimization of EPNs and CEPDHNs. Building upon 
the aforementioned, it is expected, that large scale CEPDHNs and their respective network 
graphs can be decomposed into multiple subproblems by decomposing the CEPDHNs into 
multiple operational zones among electric tie lines. Every operational zone is controlled by 
its proper ISOEMS. When decomposing the initial central optimization problem into the small 
scale subproblems it is important to fulfill the conditions of the OCD approach, described in 
Section 3.3.2. At the same time, the coupling condition can be used as a quantitative criterion 
to compare different decompositions among each other. Visually speaking, stronger coupled 
subproblems, e.g. operational zones connected by more tie lines, will converge slower than 
weakly coupled subproblems. In certain cases, when the OCD conditions are not fulfilled, a 
distinct decomposition can lead to divergence or deviations to the central solution in general. 
So far the OCD approach has not been applied to DHNs, and distributed dispatch of DHNs in 
general represents Research Gap 2. Due to the strong coupling of the subproblems, originating 
from the decomposition of optimal dispatch problems of DHNs a specially fitted reformulation 
of the DHN model was necessary. This enabled to apply the OCD approach to a small scale 
DHN, which represents Contribution 4 of this thesis. However, the expected scalability of this 
approach is not provided for DHNs, as shown in Chapter 4. 


Within Section 3.2.3 different pricing approaches have been outlaid and compared. The most 
efficient form of pricing, the locational marginal pricing approach can not be simply ap- 
plied to DHNs as two LMPs are obtained for every FNP. Also, this work is contextualized 
within the German and thereby European energy market, where uniform marginal pricing 
is mostly applied!**. Therefore, the novel hybrid pricing approach for CEPDHNs has been 
developed, which enables uniform marginal pricing in the case of uncongested network oper- 
ation. Thereby, incentive compatibility is achieved in this scenario. When operational limits 
are reached, cases may occur, were some bids and offers are paid-as-bid and pay-as-bid vice 
versa. The necessary sum needed to pay these bids and offers is collected through a grid fee. 
As the approach inherently minimizes this sum, by maximizing the welfare the expected value 


124 Within every price zone. 
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of this grid fee is low. At the same time theoretically unbounded grid fees arising via uplift 
costs from redispatch are omitted, as operational limits of the network are considered during 
market clearing. Thereby, the hybrid pricing mechanism uses a price zone for the EPN and 
every DHN in order to account for different price levels of electric energy and heat. The pre- 
sented novel pricing mechanism constitutes Contribution 3 of this work and represents an 
important part of in the transactive control system design, which yields Contribution 1. The 
interplay of, Contribution 1 and Contribution 3 help to fill Research Gap 1, which describes 
the missing coordination of market and control mechanisms within CEPDHN operation. 


Figure 5.1 summarizes how the contributions of this work help to bridge the depicted research 
gap. The later comprises the insufficient coordination of market and control mechanisms for 
CEPDHN operation, the absence of detailed CEPDHN models needed for technical efficiency 
and welfare maximization, as well as the lack of approaches for distributed optimization of 
DHNs. The designed TCS, based on the novel CEPDHN model, enables secure®, technically 
efficient and welfare maximizing operation of CEPDHNs. The simulational results presented 
in Chapter 4 illustrate benefits as loss reduction and flexibility provision. The later is achieved 
through storage capacities of DHN pipelines, thermal energy storage systems, battery stor- 
ages, as well as demand side management in the DHN and the EPN. The highly coordinated 
operation of the EPN and the DHN leads to very low curtailment of RESs. Further, the case 
studys indicate the following three aspects: First, in line with the large amount of literature in 
this field, the results show, that coupled operation of the EPN and DHNs leads to the overall 
achievable welfare maximum. Second, a naive sequential market clearing of the electricity and 
the heat markets will lead to severe challenges in the network of the second cleared market. In 
the regarded scenarios no secure network operation condition could be provided in this case. 
Third, technical efficient and welfare maximizing operation of CEPDHNs is not possible with 
prevalent model simplifications found in current literature on optimal operation of CEPDHNs. 
Performed simulations showed that providing the possibility of mass flow direction changes 
in the network model led to a 20.72 % raise of the accumulated welfare. Also, variable mass 
flows are the basis for demand-side management and lowering heat losses in DHNs. 


Several interesting aspects may be explored further by future work. These comprise the ex- 
tension of the approach to further energy domains as for example gas networks. As gases are 
much more compressible than water, and this compressibility is actively used by gas network 
operators to store more or less energy within their networks this adds a further dimension to 
the regarded approach. Also the heating value of the transported gas changes in location and 
time, especially when different gases as natural gas, green gas and hydrogen are mixed. 


Besides the approach could potentially be modified in order to enable a locational marginal 
pricing approach. However, this represents a nontrivial challenge as applying this pricing 
mechanism to DHNs brings along multiple difficulties as described in Section 3.2.3. 


The development and implementation of transactive control approaches for multi-energy sys- 
tems can reduce the costs of a future sustainable energy supply. This arises from the fact that 
these approaches can help to prevent grid reinforcements, lower operational costs through 
technical efficiency or the absence of uplift costs, and enable to achieve welfare maximizing 
operation. 


A Determination of the Nodal Admittance 
Matrix 


This section describes how the nodal admittance matrix Y? is calculated based on the 7- 
equivalent impedance Z7 and admittance Y7, shown in Figure 2.3, for all transmission lines 
e, as well as the shunt admittance vector of all buses yo: 


Based on the aforementioned, the transmission line admittance matrix yo of network edge 
e can be calculated as [ZMS11]!”°: 
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where the superscripts ff, ft,tf, and ff of the admittances Y represent a sequence of the f and 
t superscripts identifying the respective currents and voltages at the from or to end of the 
transmission line, see Figure 2.3. The auxiliary admittance column vectors ye, yY", Ye and 
Y“ are set up as: 
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with the cardinality of the EPN edges n° = |S€P". 
The nodal admittance matrix Y"® of the entire EPN is then calculated by [ZMS11]: 


Y' = diag(¥")(A°™-) ' + diag(¥") (A®™+)' (A.5) 
Yt = diag (Y“*) (APD) T + diag(¥**) (A+) T (A.6) 
YO = A=- Yf + AP™+Ytdiag(Y™) (A.7) 


where the matrices A°?™+ and A®P™” are given in (2.14). 


125 The negative sign of the admittances on the secondary diagonals originates from the opposed directions of flow 
and potential difference, see Figure 2.3. 


B Possible Forms of Decompositions 


The aim ofthe following explanations is to show that insufficient degrees of freedom for atleast 
one zone can arise, when applying different forms of decomposition. Different possible forms 
of decomposing a DHN into similarly sized subproblems as provided initially in Figure 3.10 
in the Example 3.3 are provided in the following. Four different zone partitioning possibilities 
are shown in Figure B.1 by the different Borders 1 to 4 used to decompose the small DHN into 
the two subproblems, Zone a and Zone b. Note, that for every border shown in Figure B.1 the 
complicating constraint arising from the border loop, exemplary stated in (B.2), can be either 
assigned to Zone a or Zone b. Thus eight possible forms to decompose the original problem 
can be distinguished in total in this case. Since an example based on the decomposition by 
Border 2 has already been provided in Example 3.3, which is similar to the decomposition by 
Border 1, we will first demonstrate the effects of a decomposition by Border 4, which is again 
analog to the procedure using Border 3. The complicating constraints arising from applying 
the decomposition defined by Border 4 in Zone b are given by: 


my — m2 + Mg =0 (B.1) 
Ap, + Ap2 + Ap; — Ap, =0 (B.2) 


Thereby, the complication loop equation (B.2) was assigned to Zone b. The second hydraulic 
node equation is: 
mz — m — me = 0 (B.3) 


Note, that from (B.1) and (B.3) it is apparent, that 71 = mg. Based on this from (3.46d) for e3 
it can be seen, that also Ap; is defined in this case. Using this information, from (B.2) it can be 
seen, that also the value of Ap is determined, and with (3.46d) for ea this also incorporates 
Ma. Since thereby, rng is also known from (B.1), the system of equations once more has zero 
degrees of freedom!?®, 


Note, that if the network operation would limit only one further degree of freedom, e.g. 
through a set operation point of a pump, e.g. defining Apo, then the both subproblems would 
have zero degrees of freedom in this case. 


However, for completeness it should also be noted, that using a decomposition based on Border 
2, assigning the complicating constraint of the border loop equation to Zone a would not fully 
predefine the flows and pressures in either of the zones. However, in contrast to OCD applied 
to EPNs, see Example 3.4, Zone b would have no possibility to change the flows to Zone a, 
as they are predefined in the complicating constraints originating from the hydraulic node 
equations (3.46b) of Node 2 and Node 4. 


126 Note, that the same occurs with the systems of equations of Zone a if the complicating constraint of the border 
loop equation, here (B.2), would have been assigned to Zone a. 
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Figure B.1: Example DHN decomposed into Zone a and Zone b by four possible forms (Border 1 to Border 4) to obtain 
similarly sized subproblems. 


B Possible Forms of Decompositions XXXI 


In summary, the provided forms of decomposition showed that in most cases using OCD to 
the example DHN showed in Figure B.1, the system of equations of one zone had zero degrees 
of freedom. If only a single degree of freedom of the system of hydraulic model equations, is 
reduced by the form of network operation, both zones can have zero degrees of freedom within 
their system of equations. This shows, that applying OCD to DHNs can be challenging. These 
aspects are not relevant when applying OCD to EPNs, see Example 3.4. 


C The Border Loop Equation 


This appendix provides further insight on the pressure drop loop equation, which is replaced 
by the model reformulation. The pressure drop loop equation (2.24) is replaced by the follow- 
ing equations (C.1) for border loops in the approach presented in Section 3.3.2: 
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(C.1) 
with the set ob all border loops in Zone a stated in Be In order to guarantee, that the 
pressure difference aligns with the physical flow direction, an additional inequality (C.2) is 
used, as stated below: 
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XXXIV C The Border Loop Equation 


Remark C.1: 

This formulation is equivalent to considering the differential pressure loop equation (2.24) of the 
central optimization problem, in both zones of the decomposed OCD form, for each border loop. 
This can be formulated as follows: 
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The above is equal to equation (C.1) as the constant differential pressure ApP"® in equation (C.1) 
is defined as follows for a given border loop l of zone a: 


An = ( y X Blatt). Le sini k E€ Sp (CA) 
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Strictly regarded, the replacement of the pressure drop border loop equation (2.24) by the 
above does not yet resemble a decomposition of the original central problem into decomposed 
smaller problems, as usually performed by OCD, as no complicating constraints are introduced 
here. Much more, this approach enables the pressure potentials to remain variable while using 
the OCD method, as stated in Section 3.3.2. 
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The aim to decarbonize the energy supply represents a major technical and social challenge. 
The design of approaches for future energy network operation faces the technical challenge 
of needing to coordinate a vast number of new network participants spatially and temporally, 
in order to balance energy supply and demand, while achieving secure network operation. At 
the same time these approaches should ideally provide economic optimal solutions. In order 
to meet this challenge, the research field of transactive control emerged, which is based on 
an appropriate interaction of market and control mechanisms. These approaches have been 
extensively studied for electric power networks. In order to account for the strong differences 
between the operation of electric power networks and other energy networks, new approach- 
es need to be developed. Therefore, within this work a new transactive control approach for 
Coupled Electric Power and District Heating Networks (CEPDHNs) is presented. As this is built 
upon a model-based control approach, a suitable model is designed first, which enables to 


operate coupled electric power and district heating networks as efficient as possible. Also, 


for the transactive control approach a new fitted procedure is developed to determine mar- 
ket clearing prices in the multi-energy system. Further, a distributed form of district heating 
network operation is designed in this context. The effectiveness of the presented approach 
is analyzed in multiple simulations, based on real world networks. 
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